-- Logs begin at Mon 2022-06-06 06:15:33 UTC, end at Mon 2022-06-06 07:26:06 UTC. -- Jun 06 06:55:16.531387 dv-osbrick-830800-20-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jun 06 06:55:16.543503 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 06:55:16 2022] *** Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: nodename: dv-osbrick-830800-20-ceph Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: machine: x86_64 Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: clock source: unix Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: pcre jit disabled Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: detected number of CPU cores: 4 Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: current working directory: / Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: detected binary path: /usr/bin/uwsgi-core Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: your processes number limit is 47680 Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: your memory page size is 4096 bytes Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: detected max file descriptor number: 2048 Jun 06 06:55:16.545523 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: lock engine: pthread robust mutexes Jun 06 06:55:16.546398 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: thunder lock: enabled Jun 06 06:55:16.546398 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 06 06:55:16.546398 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 06:55:16.595683 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: Python main interpreter initialized at 0x556098b799c0 Jun 06 06:55:16.595683 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: python threads support enabled Jun 06 06:55:16.595683 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: your server socket listen backlog is limited to 100 connections Jun 06 06:55:16.595683 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: your mercy for graceful operations on workers is 90 seconds Jun 06 06:55:16.596053 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 06:55:16.596129 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: *** Operational MODE: preforking *** Jun 06 06:55:16.596369 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: *** uWSGI is running in multiple interpreter mode *** Jun 06 06:55:16.596369 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: spawned uWSGI master process (pid: 87314) Jun 06 06:55:16.596565 dv-osbrick-830800-20-ceph systemd[1]: Started Devstack devstack@keystone.service. Jun 06 06:55:16.602380 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: spawned uWSGI worker 1 (pid: 87365, cores: 1) Jun 06 06:55:16.602380 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: spawned uWSGI worker 2 (pid: 87366, cores: 1) Jun 06 06:55:16.602380 dv-osbrick-830800-20-ceph devstack@keystone.service[87314]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 06:55:22.390049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 06:55:22.390049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: from cryptography.utils import int_from_bytes Jun 06 06:55:22.390869 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 06:55:22.390869 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: from cryptography.utils import int_from_bytes Jun 06 06:55:22.391065 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 06:55:22.391065 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: from cryptography.utils import int_from_bytes Jun 06 06:55:22.391516 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 06:55:22.391516 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: from cryptography.utils import int_from_bytes Jun 06 06:55:22.439767 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 06:55:22.439961 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 06:55:22.440154 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] command line args: [] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 06:55:22.440348 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 06:55:22.440439 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 06:55:22.440553 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 06:55:22.440640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ================================================================================ {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 06:55:22.440749 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] command line args: [] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 06:55:22.440830 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] admin_token = **** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.441030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 06:55:22.441123 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] config_dir = [] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.441202 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ================================================================================ {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 06:55:22.441280 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.441415 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] config_source = [] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.441493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] admin_token = **** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.441594 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] debug = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.441686 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] config_dir = [] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.441790 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442033 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442033 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] config_source = [] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442160 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442223 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] debug = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442398 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442482 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442609 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442695 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442821 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.442906 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] list_limit = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443136 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443236 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] log_config_append = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443316 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443386 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443525 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] list_limit = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] log_dir = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443709 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] log_config_append = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] log_file = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443902 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.443988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.444051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] log_dir = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.444167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.444273 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] log_file = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.444411 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.444518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.444660 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.444770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.444866 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.444971 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.445074 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.445178 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.445286 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.445416 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.445500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.445626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.445708 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.445834 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.445909 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.446161 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.446397 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.447366 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.447629 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.447888 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.448114 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.448268 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.448392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.448515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.448648 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.448790 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.448893 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.449167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.449246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.449374 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] publish_errors = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.449584 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.449722 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.449820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.449910 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] publish_errors = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.449984 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.450082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.450238 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.450322 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.450508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.450610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.450761 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] standard_threads = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.450836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.450969 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451212 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451296 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] standard_threads = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451375 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451446 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451553 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] use_journal = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451676 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451762 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] use_json = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451861 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.451965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] use_stderr = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.452039 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] use_journal = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.452115 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] use_syslog = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.452197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] use_json = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.452276 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.452370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] use_stderr = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.452510 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.452594 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] use_syslog = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.452750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.452843 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 06:55:22.453008 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.453087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.453245 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.453321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.453489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.453573 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.453727 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.453811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.453974 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.454052 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.454210 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.454297 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.454483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.454569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.454724 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.454808 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.454971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.455059 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.455204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.455283 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.455451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.455529 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.455686 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.455843 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.455919 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.455990 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.456163 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.456247 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.456401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.456488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.456650 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.456727 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.456891 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.456975 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.457133 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.457212 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.457369 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.457447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.457622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.457700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.457860 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.457946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.458116 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.458194 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.458382 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.458463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.458616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.458697 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.458848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.458932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.459077 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.459156 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.459313 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.459393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.459555 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.459633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.459794 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.459872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.460020 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.460104 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.460249 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.460328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.460493 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.460571 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.460722 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.460800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.460961 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.461037 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.461206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.461289 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.461435 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.461543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.461671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.461751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.461901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.461977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.462148 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.462278 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.462440 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.462582 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.462667 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.462740 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.462845 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.462926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.463079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.463225 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.463327 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.463466 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.463558 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.463706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.463794 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.463956 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.464039 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.464189 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.464267 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.464429 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.464515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.464662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.464741 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.464889 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.464966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.465123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.465202 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.465357 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.465436 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.465591 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.465675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.465825 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.465904 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.466061 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.466140 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.466291 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.466428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.466551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.466631 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.466784 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.466869 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.467013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.467091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.467240 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.467319 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.467488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.467574 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.467719 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.467797 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.467944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.468020 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.468170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.468257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.468405 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.468484 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.468637 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.468716 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.468876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.468955 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.469113 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.469191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.469355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.469434 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.469590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.469674 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.469824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.469970 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.470056 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.470131 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.470290 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.470389 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.470552 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.470631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.470786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.470878 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.471025 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.471103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.471263 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.471340 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.471497 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.471582 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.471731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.471817 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.471966 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.472045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.472199 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.472286 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.472433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.472511 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.472672 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.472752 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.472912 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.472999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.473146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.473224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.473386 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.473466 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.473622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.473709 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.473857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.473942 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.474090 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.474169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.474319 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.474471 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.474577 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.474658 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.474807 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.474888 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.475037 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.475122 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.475263 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.475341 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.475490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.475568 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.475720 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.475805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.475949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.476026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.476190 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.476268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.476422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.476507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.476671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.476764 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.476908 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.476986 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.477137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] auth.external = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.477228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.477365 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.477444 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.477631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.477708 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.478424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] auth.external = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.478542 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.478642 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] auth.password = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.478716 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.478868 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] auth.token = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.478947 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.479107 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.479189 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.479358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.479449 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] auth.password = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.479584 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.479666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] auth.token = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.479815 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.479901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.480050 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.480137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.480292 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.480371 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.480521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.480600 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.480752 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] credential.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.480844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.480995 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.481075 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.481224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.481303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.481461 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] credential.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.481618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.481694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.481766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.481920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.482006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.482151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.482239 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.482419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.482499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.482668 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.482748 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.482898 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.482989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.483148 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.483228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.483398 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.483479 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.483634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.483721 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.483886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.483974 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.484126 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.484204 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.484383 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.484471 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.484615 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] federation.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.484701 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.484851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.484931 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.485091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.485179 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.485333 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] federation.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.485412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.485556 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.485641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.485799 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.485880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.486031 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.486111 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.486256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.486391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.486617 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.486750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.486835 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.486910 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.487036 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.487116 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.487272 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.487364 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.487503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.487589 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.487747 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.487827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.487990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.488077 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.488221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.488300 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.488448 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.488526 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.488692 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.488773 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.488920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.489000 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.489151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.489230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.489393 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.489472 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.489626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.489706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.489857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.489935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.490088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.490169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.490318 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.490421 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.490579 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.490658 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.490812 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.490901 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.491047 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.491127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.491292 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.491372 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.491534 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.491614 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.491779 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.491858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.492022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.492100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.492259 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.492377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.492489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.492569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.492724 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.492804 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.492953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.493042 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.493184 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.493264 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.493465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.494097 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.494215 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.494385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.494468 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.494543 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.494708 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.494788 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.494951 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.495031 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.495199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.495277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.495432 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.495519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.495677 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.495756 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.495917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.496002 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.496147 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.496240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.496383 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.496463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.496611 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.496690 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.496844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.496931 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.497077 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.497156 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.497304 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.497389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.497538 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.497625 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.497772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.497851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.498013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.498094 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.498252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.498360 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.498505 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.498585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.498736 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.498816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.498983 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.499075 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.499213 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.499293 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.499445 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.499525 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.499676 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.499763 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.499910 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.500245 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.500393 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.500479 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.500626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.500717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.500862 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.500942 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.501094 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.501173 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.501335 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.501422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.501580 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.501660 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.501811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.501892 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.502048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.502138 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.502278 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.502377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.502539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.502620 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.502774 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.502866 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.503001 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.503080 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.503227 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.503306 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.503459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.503555 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.503696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.503780 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.503925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.504004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.504166 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.504253 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.504408 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.504487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.504633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.504711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.504877 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.505032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.505109 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.505182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.505334 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.505413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.505564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.505651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.505797 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.505878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.506030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.506109 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.506266 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.506401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.506526 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.506607 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.506771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.506850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.507018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.507110 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.507255 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.507335 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.507500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.507578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.507729 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.507816 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.507963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.508041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.508197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.508275 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.508432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.508521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.508660 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.508738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.508898 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.508998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.509163 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.509250 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] resource.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.509398 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.509478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.509636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.509715 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.509872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.509958 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] resource.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.510118 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.510197 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.510383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.510467 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.510621 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.510713 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.510866 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.510946 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.511102 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.511181 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.511335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.511414 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.511565 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] role.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.511643 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.511804 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.511882 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] role.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.512032 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.512114 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.512266 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] role.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.512344 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.512509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.512588 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] role.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.512738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.512818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.512986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.513064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.513228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.513307 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.513469 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.513549 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.513712 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.513792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.513953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.514032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.514185 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.514266 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.514451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.514532 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.514696 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.514775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.514929 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.515009 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.515173 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.515252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.515416 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.515564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.515652 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.515799 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.515879 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.516046 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.516279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.516359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.516520 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.516601 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.516761 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.516840 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.516993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.517081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.517246 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.517326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.517492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.517575 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.517726 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.517814 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.517958 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.518039 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.518187 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.518268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.518440 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.518534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.518687 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.518766 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.518920 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.519000 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.519152 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.519244 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.519385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.519464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.519620 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.519700 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.519848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.519936 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.520080 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] token.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.520161 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.520316 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.520396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.520547 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.520634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.520778 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.520857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] token.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.521013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.521092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.521258 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.521344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.521492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.521570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.521732 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.521810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.521973 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.522061 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.522208 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.522287 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.522464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.522544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.522701 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.522794 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.522933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.523014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.523169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.523248 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.523411 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.523503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.523667 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.523747 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.523863 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.523943 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.524112 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.524200 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.524344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.524425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.connection = **** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.524587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.524697 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.524894 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.524974 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.525129 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.525217 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.connection = **** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.525369 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.525454 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.525587 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.525667 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.525820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.525901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.526054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.526136 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.526287 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.526424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.526550 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.526630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.526782 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.526863 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.527017 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.527095 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.527246 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.527325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.527488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.527568 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.527717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.527796 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.527958 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.528036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.528181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.528261 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.528418 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.528498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.528649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.528729 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.528811 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 06:55:22.528886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.529104 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.529348 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 06:55:22.529520 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 06:55:22.558477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.558704 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.558821 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.558938 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.559052 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.559277 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.567340 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.567753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.594746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.594971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.595165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.595396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.648590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.648734 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.697896 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.698127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.699372 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.699606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.765928 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.766124 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.766219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.766385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.766506 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.766619 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.766746 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.766827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.766904 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.767035 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.767121 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.767249 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.789950 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.790172 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.790320 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.790484 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.790614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.790743 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.790906 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.791048 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.791180 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.791308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.791454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.791587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.791678 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.791678 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.802009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.802217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.815286 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.815463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.815573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.815707 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.815794 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.815925 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.816009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.816142 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.816227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.816355 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.816438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.816559 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.816654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.816753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 06 06:55:22.834064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.834272 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 06:55:22.834375 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.834569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 06:55:22.834668 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.834814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 06:55:22.834898 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.835083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.835166 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 06 06:55:22.835343 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.835427 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.835598 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.835682 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.835851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.835932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.836099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.846802 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.847077 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.847162 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.847343 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.847441 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.847622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.847704 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.847898 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.855728 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.859005 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.859283 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.859559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.859723 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.859833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.860106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.860362 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.860627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.860894 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.861264 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.861535 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.861800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.863059 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.863342 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.863621 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.863897 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.864172 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.864430 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.864697 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.864967 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.865341 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.865616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.865883 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.889451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.891092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.891380 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.896754 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.897040 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.897329 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.897877 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.899615 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.899856 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.904623 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.904899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.905300 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.905585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.905864 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.909390 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.909673 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.909953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.910233 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.912359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.912359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.912359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.912359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.913262 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.913495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.918039 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.918323 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.918624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.918906 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.919292 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.919583 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.919868 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.920136 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.929824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.930100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.935257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.938856 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.939114 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.939199 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.939397 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.944034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.944131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.948191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.948975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.949381 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.951785 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.952077 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.952358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.952748 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.953025 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.953299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.954357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.957897 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.961502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.961801 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.962101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.962523 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.962804 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.963086 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.971873 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.972152 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.972417 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.972679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.981741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.982025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.982208 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.982302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.982568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.983943 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.984227 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.987282 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.987558 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.987840 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.988116 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.988397 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.991988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.994245 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.994544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.997557 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:22.997838 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.998117 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.998427 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:22.998712 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.002596 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.002873 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.003159 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.003435 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.003710 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.003977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.004248 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.012819 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.013105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.013383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.013661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.013941 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.014213 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.014515 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.022464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.025819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.029127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.030754 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.032335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.032441 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.032627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.032914 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.035711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.039084 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.040793 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.041234 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.042428 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.042882 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.043163 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.043449 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.045633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.045911 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.046191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.046493 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.050828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.052448 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.055487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.055693 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.055778 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.056535 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.056643 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.056819 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.057094 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.064517 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.064796 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.065071 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.065344 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.065611 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.065882 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.066127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.066210 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.066436 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.066524 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.066700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.066781 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.066976 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.067242 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.067500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.067760 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.068033 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.074669 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 06 06:55:23.074947 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.075221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.075491 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.075758 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.076036 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.076307 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.076584 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.076850 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.077117 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.077396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.077654 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.077929 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.078194 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 06 06:55:23.105921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556098b799c0 pid: 87365 (default app) Jun 06 06:55:23.109172 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690dea-2bfe-4cfe-960b-9251678ab275 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:23.109464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690dea-2bfe-4cfe-960b-9251678ab275 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:23.109743 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690dea-2bfe-4cfe-960b-9251678ab275 None None] PATH_INFO: `/v3` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:23.114177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Mon Jun 6 06:55:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:23.120390 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556098b799c0 pid: 87366 (default app) Jun 06 06:55:32.272902 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbbb08-84ad-4fc9-860b-bd86a8cdea07 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:32.273447 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbbb08-84ad-4fc9-860b-bd86a8cdea07 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:32.273447 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbbb08-84ad-4fc9-860b-bd86a8cdea07 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:32.274791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:55:32.282147 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:32.282629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:32.282730 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:32.354455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: INFO dbcounter [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] Registered counter for database keystone Jun 06 06:55:32.376255 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG oslo_db.sqlalchemy.engines [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 06:55:32.382467 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writer thread running {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 06:55:32.679476 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG passlib.handlers.bcrypt [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87366) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 06 06:55:32.679888 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG passlib.handlers.bcrypt [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87366) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 06 06:55:32.737632 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:32.739250 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:32.863590 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 1/3] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 584 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 06 06:55:33.037235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbbb08-84ad-4fc9-860b-bd86a8cdea07 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:33.111309 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: INFO dbcounter [None req-2fdbbb08-84ad-4fc9-860b-bd86a8cdea07 None None] Registered counter for database keystone Jun 06 06:55:33.131165 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG oslo_db.sqlalchemy.engines [None req-2fdbbb08-84ad-4fc9-860b-bd86a8cdea07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 06:55:33.137269 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writer thread running {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 06:55:33.358049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbbb08-84ad-4fc9-860b-bd86a8cdea07 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:33.362478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445ae36-0173-4aba-975e-f7c67ac6059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:33.363135 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445ae36-0173-4aba-975e-f7c67ac6059f admin admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:33.363425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445ae36-0173-4aba-975e-f7c67ac6059f admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:33.363706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445ae36-0173-4aba-975e-f7c67ac6059f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:33.372300 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445ae36-0173-4aba-975e-f7c67ac6059f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:33.424024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4445ae36-0173-4aba-975e-f7c67ac6059f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 06 06:55:33.424370 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445ae36-0173-4aba-975e-f7c67ac6059f admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:33.433774 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1324 bytes} [Mon Jun 6 06:55:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 06:55:33.439811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:33.454001 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4008-7af5-4652-9a2c-aa9c31c32043 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:33.458357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2e8f-aef5-4584-bf46-a0247221ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:33.459503 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2e8f-aef5-4584-bf46-a0247221ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:33.459789 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2e8f-aef5-4584-bf46-a0247221ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:33.460065 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2e8f-aef5-4584-bf46-a0247221ab1c admin admin] PATH_INFO: `/v3/projects/0d774be4b4f647c4aa73f115724f3d96` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:33.461661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2e8f-aef5-4584-bf46-a0247221ab1c admin admin] RBAC: Authorizing `identity:get_project(project_id=0d774be4b4f647c4aa73f115724f3d96)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:33.513642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING keystone.common.rbac_enforcer.enforcer [None req-756d2e8f-aef5-4584-bf46-a0247221ab1c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 06 06:55:33.513987 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2e8f-aef5-4584-bf46-a0247221ab1c admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:33.518567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 2/5] 10.222.0.42 () {56 vars in 1207 bytes} [Mon Jun 6 06:55:33 2022] GET /identity/v3/projects/0d774be4b4f647c4aa73f115724f3d96 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:35.783408 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ae31-f29c-4737-b35e-3447f519bd61 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:35.783952 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ae31-f29c-4737-b35e-3447f519bd61 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:35.783952 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ae31-f29c-4737-b35e-3447f519bd61 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:35.788186 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 4/6] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:55:35.794291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0cd66-106a-4483-b190-bb91af7a37d0 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:35.794723 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0cd66-106a-4483-b190-bb91af7a37d0 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:35.794885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0cd66-106a-4483-b190-bb91af7a37d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:35.813931 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-c1b0cd66-106a-4483-b190-bb91af7a37d0 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:35.815480 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-c1b0cd66-106a-4483-b190-bb91af7a37d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:35.824797 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 3/7] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 06 06:55:35.848950 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7ae31-f29c-4737-b35e-3447f519bd61 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:35.861825 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7ae31-f29c-4737-b35e-3447f519bd61 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:35.866072 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3ea80-d18e-4149-8a91-8cf62169f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:35.866744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ea80-d18e-4149-8a91-8cf62169f783 admin admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:35.867036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ea80-d18e-4149-8a91-8cf62169f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:35.867319 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ea80-d18e-4149-8a91-8cf62169f783 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:35.875972 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3ea80-d18e-4149-8a91-8cf62169f783 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:35.877746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3ea80-d18e-4149-8a91-8cf62169f783 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:35.886492 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1324 bytes} [Mon Jun 6 06:55:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 06 06:55:35.891820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0cd66-106a-4483-b190-bb91af7a37d0 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:35.900902 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0cd66-106a-4483-b190-bb91af7a37d0 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:35.905336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccff56-7385-463d-b4ec-f93433afaff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:35.906194 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccff56-7385-463d-b4ec-f93433afaff9 admin admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:35.906530 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccff56-7385-463d-b4ec-f93433afaff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:35.906816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccff56-7385-463d-b4ec-f93433afaff9 admin admin] PATH_INFO: `/v3/users/d63265941a9946a497001fc63bf2b23c` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:35.908223 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccff56-7385-463d-b4ec-f93433afaff9 admin admin] RBAC: Authorizing `identity:get_user(user_id=d63265941a9946a497001fc63bf2b23c)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:35.910067 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccff56-7385-463d-b4ec-f93433afaff9 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:35.911689 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 4/9] 10.222.0.42 () {56 vars in 1198 bytes} [Mon Jun 6 06:55:35 2022] GET /identity/v3/users/d63265941a9946a497001fc63bf2b23c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:38.240295 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161472c-eb15-456b-978f-619c4e9b21fe None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:38.240779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161472c-eb15-456b-978f-619c4e9b21fe None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:38.240779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161472c-eb15-456b-978f-619c4e9b21fe None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:38.242148 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:38.247944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e254-4cad-4ce2-8e55-03352eb3686f None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:38.248367 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e254-4cad-4ce2-8e55-03352eb3686f None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:38.248505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e254-4cad-4ce2-8e55-03352eb3686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:38.265036 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-69b6e254-4cad-4ce2-8e55-03352eb3686f None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:38.266197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-69b6e254-4cad-4ce2-8e55-03352eb3686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:38.305080 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263ce0d-be13-4fdd-ae5a-4e3648632047 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:38.305378 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263ce0d-be13-4fdd-ae5a-4e3648632047 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:38.305667 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263ce0d-be13-4fdd-ae5a-4e3648632047 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:38.307611 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 7/11] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:55:38.312780 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117903-bf37-46b6-815d-e0682f5cffcc None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:38.313074 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117903-bf37-46b6-815d-e0682f5cffcc None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:38.313361 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117903-bf37-46b6-815d-e0682f5cffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:38.346506 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 5/12] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:38.354182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG passlib.handlers.bcrypt [None req-5e117903-bf37-46b6-815d-e0682f5cffcc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87365) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 06 06:55:38.354707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG passlib.handlers.bcrypt [None req-5e117903-bf37-46b6-815d-e0682f5cffcc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87365) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 06 06:55:38.371603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6e254-4cad-4ce2-8e55-03352eb3686f None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:38.394660 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:38.402163 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-5e117903-bf37-46b6-815d-e0682f5cffcc None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:38.403781 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-5e117903-bf37-46b6-815d-e0682f5cffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:38.471938 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6e254-4cad-4ce2-8e55-03352eb3686f None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:38.501101 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:55:38.505753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7990a-7176-45e3-94f8-074834876710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:38.506582 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7990a-7176-45e3-94f8-074834876710 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:38.506874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7990a-7176-45e3-94f8-074834876710 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:38.507158 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7990a-7176-45e3-94f8-074834876710 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:38.518389 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7990a-7176-45e3-94f8-074834876710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:55:38.529284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e117903-bf37-46b6-815d-e0682f5cffcc None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-20f7990a-7176-45e3-94f8-074834876710 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:55:38.529951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:38.531044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:55:38.532232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 6/14] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:55:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:55:38.536723 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7990a-7176-45e3-94f8-074834876710 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:38.617682 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:38.630053 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e117903-bf37-46b6-815d-e0682f5cffcc None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:38.635814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:38.635944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7990a-7176-45e3-94f8-074834876710 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:38.669050 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ef5f7-abe4-44aa-b2ae-3d088188cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:38.669945 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ef5f7-abe4-44aa-b2ae-3d088188cf22 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:38.670050 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264997b-e991-44f9-85a9-59366ab8a4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:38.670240 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ef5f7-abe4-44aa-b2ae-3d088188cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:38.670554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ef5f7-abe4-44aa-b2ae-3d088188cf22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:38.670644 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264997b-e991-44f9-85a9-59366ab8a4ef None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:38.670925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264997b-e991-44f9-85a9-59366ab8a4ef None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:38.671208 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264997b-e991-44f9-85a9-59366ab8a4ef None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:38.671968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264997b-e991-44f9-85a9-59366ab8a4ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:38.672279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264997b-e991-44f9-85a9-59366ab8a4ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:38.673682 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264997b-e991-44f9-85a9-59366ab8a4ef None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:38.686647 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 7/15] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:38.692103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264997b-e991-44f9-85a9-59366ab8a4ef None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:38.738613 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ef5f7-abe4-44aa-b2ae-3d088188cf22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:38.740329 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ef5f7-abe4-44aa-b2ae-3d088188cf22 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:38.790816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264997b-e991-44f9-85a9-59366ab8a4ef None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:38.847659 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bc41e-91e0-4c8b-8b5d-0c074586a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:38.848544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc41e-91e0-4c8b-8b5d-0c074586a13d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:38.848831 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc41e-91e0-4c8b-8b5d-0c074586a13d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:38.849111 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc41e-91e0-4c8b-8b5d-0c074586a13d None admin] PATH_INFO: `/v3/users/d63265941a9946a497001fc63bf2b23c` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:38.850184 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:55:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 06:55:38.850320 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bc41e-91e0-4c8b-8b5d-0c074586a13d None admin] RBAC: Authorizing `identity:get_user(user_id=d63265941a9946a497001fc63bf2b23c)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:38.851812 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bc41e-91e0-4c8b-8b5d-0c074586a13d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:38.857434 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 8/17] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:55:38 2022] GET /identity/v3/users/d63265941a9946a497001fc63bf2b23c => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:38.857579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ef5f7-abe4-44aa-b2ae-3d088188cf22 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:38.858927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:38.859819 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bc41e-91e0-4c8b-8b5d-0c074586a13d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:38.874500 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:38.963731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ef5f7-abe4-44aa-b2ae-3d088188cf22 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:38.968078 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bc41e-91e0-4c8b-8b5d-0c074586a13d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:38.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a0031-f9fb-40c0-b9fb-f17a6701ea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:38.996713 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a0031-f9fb-40c0-b9fb-f17a6701ea0a None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:38.997000 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a0031-f9fb-40c0-b9fb-f17a6701ea0a None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:38.997276 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a0031-f9fb-40c0-b9fb-f17a6701ea0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:39.002486 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6998db-139a-499b-a430-abdd865c9d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:39.003277 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6998db-139a-499b-a430-abdd865c9d97 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:39.003564 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6998db-139a-499b-a430-abdd865c9d97 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:39.003845 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6998db-139a-499b-a430-abdd865c9d97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:39.005032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6998db-139a-499b-a430-abdd865c9d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:39.006524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6998db-139a-499b-a430-abdd865c9d97 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:39.008136 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:39.014222 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6998db-139a-499b-a430-abdd865c9d97 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:39.016510 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a0031-f9fb-40c0-b9fb-f17a6701ea0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:39.017969 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a0031-f9fb-40c0-b9fb-f17a6701ea0a None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-ad1a0031-f9fb-40c0-b9fb-f17a6701ea0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:55:39.038857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:39.039867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:39.040976 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:55:39.040976 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:55:39.040976 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:55:39.040976 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:55:39.040976 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:55:39.045765 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a0031-f9fb-40c0-b9fb-f17a6701ea0a None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:39.096423 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:39.101435 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:39.115213 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6998db-139a-499b-a430-abdd865c9d97 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:39.145981 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a0031-f9fb-40c0-b9fb-f17a6701ea0a None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:39.150725 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9cbf-4159-4bf0-aea1-743948116819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:39.151379 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9cbf-4159-4bf0-aea1-743948116819 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:39.151660 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9cbf-4159-4bf0-aea1-743948116819 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:39.151938 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9cbf-4159-4bf0-aea1-743948116819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:39.152775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b9cbf-4159-4bf0-aea1-743948116819 None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.domain.id=default, user.id=d63265941a9946a497001fc63bf2b23c) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:39.153088 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b9cbf-4159-4bf0-aea1-743948116819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:39.154556 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b9cbf-4159-4bf0-aea1-743948116819 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:39.161704 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1322 bytes} [Mon Jun 6 06:55:39 2022] GET /identity/v3/role_assignments?user.id=d63265941a9946a497001fc63bf2b23c&scope.domain.id=default&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:39.180669 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994be22-d5ce-49f6-839a-fe15637b1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:39.181905 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994be22-d5ce-49f6-839a-fe15637b1d4d None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:39.182196 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994be22-d5ce-49f6-839a-fe15637b1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:39.182525 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994be22-d5ce-49f6-839a-fe15637b1d4d None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:39.183310 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994be22-d5ce-49f6-839a-fe15637b1d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:39.183622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994be22-d5ce-49f6-839a-fe15637b1d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:39.185100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994be22-d5ce-49f6-839a-fe15637b1d4d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:39.207549 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:41.823203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da59c7-c94f-4ac1-b37d-864bab51172a None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:41.823759 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da59c7-c94f-4ac1-b37d-864bab51172a None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:41.824041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da59c7-c94f-4ac1-b37d-864bab51172a None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:41.825860 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:41.831773 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9fe84-3beb-4b27-8466-802c9abd7503 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:41.832644 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9fe84-3beb-4b27-8466-802c9abd7503 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:41.833336 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9fe84-3beb-4b27-8466-802c9abd7503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:41.855335 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-2ef9fe84-3beb-4b27-8466-802c9abd7503 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:41.856863 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-2ef9fe84-3beb-4b27-8466-802c9abd7503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:41.940990 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf9e5b-bb01-4292-b156-dced40c88fa1 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:41.941275 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf9e5b-bb01-4292-b156-dced40c88fa1 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:41.941719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf9e5b-bb01-4292-b156-dced40c88fa1 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:41.943563 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 12/23] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:41.949025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d37bc-25af-477a-b80e-f94a1a18add9 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:41.949507 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d37bc-25af-477a-b80e-f94a1a18add9 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:41.949940 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d37bc-25af-477a-b80e-f94a1a18add9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:41.975931 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 12/24] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:55:41.983519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-c84d37bc-25af-477a-b80e-f94a1a18add9 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:41.985006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-c84d37bc-25af-477a-b80e-f94a1a18add9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:42.061154 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9fe84-3beb-4b27-8466-802c9abd7503 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:42.096824 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:42.122684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d37bc-25af-477a-b80e-f94a1a18add9 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:42.160205 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:42.211949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:42.239872 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d37bc-25af-477a-b80e-f94a1a18add9 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:42.279680 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5beb0f-1bb9-4995-b938-d2e0aa12ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:42.280871 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5beb0f-1bb9-4995-b938-d2e0aa12ecea None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:42.281362 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5beb0f-1bb9-4995-b938-d2e0aa12ecea None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:42.281844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5beb0f-1bb9-4995-b938-d2e0aa12ecea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:42.293157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9fe84-3beb-4b27-8466-802c9abd7503 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:42.293991 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5beb0f-1bb9-4995-b938-d2e0aa12ecea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:42.295895 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5beb0f-1bb9-4995-b938-d2e0aa12ecea None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-9e5beb0f-1bb9-4995-b938-d2e0aa12ecea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:55:42.318698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:42.319578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:42.320370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:55:42.320370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:55:42.320370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:55:42.320370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:55:42.323064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 14/26] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:55:42.333747 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5beb0f-1bb9-4995-b938-d2e0aa12ecea None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:42.371434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365bc87-19f8-4663-b9c1-e2243091f9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:42.372162 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365bc87-19f8-4663-b9c1-e2243091f9ea None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:42.372654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365bc87-19f8-4663-b9c1-e2243091f9ea None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:42.373200 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365bc87-19f8-4663-b9c1-e2243091f9ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:42.410672 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365bc87-19f8-4663-b9c1-e2243091f9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-0365bc87-19f8-4663-b9c1-e2243091f9ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:55:42.433744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:42.434674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:55:42.435434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:55:42.444112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 13/27] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:55:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:55:42.451197 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365bc87-19f8-4663-b9c1-e2243091f9ea None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:42.552116 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5beb0f-1bb9-4995-b938-d2e0aa12ecea None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:42.604543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:42.614139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a045d1-a9c5-4d2e-afa2-98fc40bd3253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:42.615095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a045d1-a9c5-4d2e-afa2-98fc40bd3253 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:42.624237 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a045d1-a9c5-4d2e-afa2-98fc40bd3253 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:42.624237 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a045d1-a9c5-4d2e-afa2-98fc40bd3253 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:42.624237 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a045d1-a9c5-4d2e-afa2-98fc40bd3253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:42.624237 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a045d1-a9c5-4d2e-afa2-98fc40bd3253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:42.624237 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a045d1-a9c5-4d2e-afa2-98fc40bd3253 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:42.637528 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 15/28] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:42.638974 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365bc87-19f8-4663-b9c1-e2243091f9ea None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:42.639280 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cceeb1-7284-4f2f-8f39-fab7f2673e76 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:42.639887 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cceeb1-7284-4f2f-8f39-fab7f2673e76 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:42.640747 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cceeb1-7284-4f2f-8f39-fab7f2673e76 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:42.643341 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 16/29] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:42.644173 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779cef8-6e46-47ad-bec0-1f95e514b27d None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:42.644916 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779cef8-6e46-47ad-bec0-1f95e514b27d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:42.645306 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779cef8-6e46-47ad-bec0-1f95e514b27d None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:42.646920 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 17/30] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:42.649240 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:42.652052 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779cef8-6e46-47ad-bec0-1f95e514b27d None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:42.687351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b39254-f8f6-402e-915f-90b6233aa0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:42.688657 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b39254-f8f6-402e-915f-90b6233aa0f1 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:42.689184 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b39254-f8f6-402e-915f-90b6233aa0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:42.689654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b39254-f8f6-402e-915f-90b6233aa0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:42.690733 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b39254-f8f6-402e-915f-90b6233aa0f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:42.691490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b39254-f8f6-402e-915f-90b6233aa0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:42.694046 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b39254-f8f6-402e-915f-90b6233aa0f1 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:42.710260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 14/31] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:55:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:42.712751 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8776a6-39b1-4778-a0a6-624b2e661eec None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:42.713268 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8776a6-39b1-4778-a0a6-624b2e661eec None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:42.713982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8776a6-39b1-4778-a0a6-624b2e661eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:42.741253 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-be8776a6-39b1-4778-a0a6-624b2e661eec None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:42.744252 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-be8776a6-39b1-4778-a0a6-624b2e661eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:42.762941 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779cef8-6e46-47ad-bec0-1f95e514b27d None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:42.800226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ffcf-74d5-432a-862e-63e7577980f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:42.800900 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ffcf-74d5-432a-862e-63e7577980f2 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:42.801190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ffcf-74d5-432a-862e-63e7577980f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:42.801473 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ffcf-74d5-432a-862e-63e7577980f2 None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:42.802505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65ffcf-74d5-432a-862e-63e7577980f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:42.803713 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65ffcf-74d5-432a-862e-63e7577980f2 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:42.843495 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 15/32] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:42.845742 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a3ddd-8638-4efb-a541-f204dab6c402 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:42.846392 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a3ddd-8638-4efb-a541-f204dab6c402 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:42.846887 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a3ddd-8638-4efb-a541-f204dab6c402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:42.864028 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-c83a3ddd-8638-4efb-a541-f204dab6c402 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:42.865593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-c83a3ddd-8638-4efb-a541-f204dab6c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:42.951170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 16/33] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:42.952473 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a3ddd-8638-4efb-a541-f204dab6c402 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:42.991312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:43.074244 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a3ddd-8638-4efb-a541-f204dab6c402 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:43.080250 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 18/34] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:55:42 2022] POST /identity/v3/projects => generated 301 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:55:43.081543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ffcf-74d5-432a-862e-63e7577980f2 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:43.124692 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f026f-0bca-4655-8475-2020917c3b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:43.126121 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f026f-0bca-4655-8475-2020917c3b62 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.126623 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f026f-0bca-4655-8475-2020917c3b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.127050 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f026f-0bca-4655-8475-2020917c3b62 None admin] PATH_INFO: `/v3/users/d63265941a9946a497001fc63bf2b23c` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.128816 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f026f-0bca-4655-8475-2020917c3b62 None admin] RBAC: Authorizing `identity:get_user(user_id=d63265941a9946a497001fc63bf2b23c)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:43.129711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:43.131177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f026f-0bca-4655-8475-2020917c3b62 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:43.133255 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 17/35] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:55:42 2022] GET /identity/v3/users/d63265941a9946a497001fc63bf2b23c => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:43.135317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f026f-0bca-4655-8475-2020917c3b62 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:43.211930 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ffcf-74d5-432a-862e-63e7577980f2 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:43.257529 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:43.265338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f026f-0bca-4655-8475-2020917c3b62 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:43.266086 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fced1d-aa8b-4d56-8c1f-dc2908338727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:43.266998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fced1d-aa8b-4d56-8c1f-dc2908338727 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.267661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fced1d-aa8b-4d56-8c1f-dc2908338727 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.268080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fced1d-aa8b-4d56-8c1f-dc2908338727 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.270051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fced1d-aa8b-4d56-8c1f-dc2908338727 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:43.271776 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fced1d-aa8b-4d56-8c1f-dc2908338727 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:43.314882 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d574135-39f1-40bf-afcc-ea3f5a84b5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:43.315896 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d574135-39f1-40bf-afcc-ea3f5a84b5bd None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.316368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d574135-39f1-40bf-afcc-ea3f5a84b5bd None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.316808 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d574135-39f1-40bf-afcc-ea3f5a84b5bd None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.317783 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d574135-39f1-40bf-afcc-ea3f5a84b5bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:43.319936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d574135-39f1-40bf-afcc-ea3f5a84b5bd None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:43.385713 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 19/36] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Jun 6 06:55:43 2022] POST /identity/v3/roles => generated 219 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:55:43.386878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fced1d-aa8b-4d56-8c1f-dc2908338727 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:43.521727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:43.526780 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fced1d-aa8b-4d56-8c1f-dc2908338727 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:43.542263 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Jun 6 06:55:43 2022] POST /identity/v3/roles => generated 225 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:55:43.544285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f9a05-809a-4300-8be9-84ea291767cc None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.544826 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f9a05-809a-4300-8be9-84ea291767cc None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.545317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f9a05-809a-4300-8be9-84ea291767cc None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.547187 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 19/38] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:43.553695 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ecbeb-9cfb-4ef4-ba20-8d584780b0cd None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.554371 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ecbeb-9cfb-4ef4-ba20-8d584780b0cd None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.554895 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ecbeb-9cfb-4ef4-ba20-8d584780b0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.570450 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6514d5-0a01-4854-9185-9fda2e9465ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:43.571275 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6514d5-0a01-4854-9185-9fda2e9465ea None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.571620 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6514d5-0a01-4854-9185-9fda2e9465ea None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.571906 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6514d5-0a01-4854-9185-9fda2e9465ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.573312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6514d5-0a01-4854-9185-9fda2e9465ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:43.575032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6514d5-0a01-4854-9185-9fda2e9465ea None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:43.577197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 20/39] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:43.584010 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-7d8ecbeb-9cfb-4ef4-ba20-8d584780b0cd None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:43.584010 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-7d8ecbeb-9cfb-4ef4-ba20-8d584780b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:43.584198 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6514d5-0a01-4854-9185-9fda2e9465ea None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:43.662622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:55:43.684578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ecbeb-9cfb-4ef4-ba20-8d584780b0cd None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:43.710672 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6514d5-0a01-4854-9185-9fda2e9465ea None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:43.752199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b22876-2724-4c83-8920-20af714558f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:43.753379 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b22876-2724-4c83-8920-20af714558f0 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.753677 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b22876-2724-4c83-8920-20af714558f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.753963 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b22876-2724-4c83-8920-20af714558f0 None admin] PATH_INFO: `/v3/domains/default/users/d63265941a9946a497001fc63bf2b23c/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.756409 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b22876-2724-4c83-8920-20af714558f0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d63265941a9946a497001fc63bf2b23c, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:43.758071 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b22876-2724-4c83-8920-20af714558f0 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:43.790408 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:43.807595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ecbeb-9cfb-4ef4-ba20-8d584780b0cd None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:43.845242 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e6b6e-fd1e-4af1-8ca8-60b8636a0eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:43.845921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e6b6e-fd1e-4af1-8ca8-60b8636a0eaf None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.846212 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e6b6e-fd1e-4af1-8ca8-60b8636a0eaf None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.846524 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e6b6e-fd1e-4af1-8ca8-60b8636a0eaf None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.847294 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e6b6e-fd1e-4af1-8ca8-60b8636a0eaf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:43.848807 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e6b6e-fd1e-4af1-8ca8-60b8636a0eaf None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:43.909933 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1361 bytes} [Mon Jun 6 06:55:43 2022] PUT /identity/v3/domains/default/users/d63265941a9946a497001fc63bf2b23c/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:55:43.916146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e05ed-3d9f-46fa-ad6c-7c5569caf618 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.916458 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e05ed-3d9f-46fa-ad6c-7c5569caf618 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.916751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e05ed-3d9f-46fa-ad6c-7c5569caf618 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.918175 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 22/42] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:43.924478 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992e342-313a-4e4e-bafb-052305e81615 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:43.925026 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992e342-313a-4e4e-bafb-052305e81615 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:43.925377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992e342-313a-4e4e-bafb-052305e81615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:43.944476 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-c992e342-313a-4e4e-bafb-052305e81615 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:43.946075 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-c992e342-313a-4e4e-bafb-052305e81615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:43.952076 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 21/43] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Jun 6 06:55:43 2022] POST /identity/v3/roles => generated 223 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:55:43.974214 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:44.033228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 23/44] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:55:44.068354 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e6b6e-fd1e-4af1-8ca8-60b8636a0eaf None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:44.183514 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e6b6e-fd1e-4af1-8ca8-60b8636a0eaf None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:44.219343 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6544a41-b2bd-440e-874b-bcafd1f1ff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:44.220146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6544a41-b2bd-440e-874b-bcafd1f1ff91 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:44.220570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6544a41-b2bd-440e-874b-bcafd1f1ff91 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:44.220858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6544a41-b2bd-440e-874b-bcafd1f1ff91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:44.222053 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6544a41-b2bd-440e-874b-bcafd1f1ff91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:44.223561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6544a41-b2bd-440e-874b-bcafd1f1ff91 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:44.225181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 22/45] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:44.231355 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992e342-313a-4e4e-bafb-052305e81615 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:44.330492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992e342-313a-4e4e-bafb-052305e81615 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:44.363909 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f2a60-d6d3-4062-b575-d04d593151ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:44.364587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f2a60-d6d3-4062-b575-d04d593151ac None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:44.364880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f2a60-d6d3-4062-b575-d04d593151ac None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:44.365168 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f2a60-d6d3-4062-b575-d04d593151ac None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:44.365899 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f2a60-d6d3-4062-b575-d04d593151ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:44.367428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f2a60-d6d3-4062-b575-d04d593151ac None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:44.436663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:55:44 2022] POST /identity/v3/projects => generated 312 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:55:46.246668 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f302d-9933-438d-a3bc-a3d601edaab4 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:46.247157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f302d-9933-438d-a3bc-a3d601edaab4 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:46.247157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f302d-9933-438d-a3bc-a3d601edaab4 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:46.248508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:46.254125 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e908-cc0a-41c5-b1d3-fe104fbee9a8 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:46.254565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e908-cc0a-41c5-b1d3-fe104fbee9a8 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:46.254738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e908-cc0a-41c5-b1d3-fe104fbee9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:46.271872 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-e590e908-cc0a-41c5-b1d3-fe104fbee9a8 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:46.273071 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-e590e908-cc0a-41c5-b1d3-fe104fbee9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:46.275646 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:46.341381 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:46.365045 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f302d-9933-438d-a3bc-a3d601edaab4 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:46.382223 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:46.470174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f302d-9933-438d-a3bc-a3d601edaab4 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:46.503222 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7784d-40b0-421d-ad59-c3af83db8f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:46.503930 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7784d-40b0-421d-ad59-c3af83db8f91 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:46.504217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7784d-40b0-421d-ad59-c3af83db8f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:46.504500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7784d-40b0-421d-ad59-c3af83db8f91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:46.515049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7784d-40b0-421d-ad59-c3af83db8f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-99b7784d-40b0-421d-ad59-c3af83db8f91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:55:46.522590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:46.523456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:55:46.524219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 24/49] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:55:46.530385 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e908-cc0a-41c5-b1d3-fe104fbee9a8 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:46.626792 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e908-cc0a-41c5-b1d3-fe104fbee9a8 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:46.659295 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d457f-b05e-43e1-84f1-8bc2e5c6fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:46.659958 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d457f-b05e-43e1-84f1-8bc2e5c6fe0e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:46.660245 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d457f-b05e-43e1-84f1-8bc2e5c6fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:46.660533 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d457f-b05e-43e1-84f1-8bc2e5c6fe0e None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:46.661280 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d457f-b05e-43e1-84f1-8bc2e5c6fe0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:46.661590 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d457f-b05e-43e1-84f1-8bc2e5c6fe0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:46.663019 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d457f-b05e-43e1-84f1-8bc2e5c6fe0e None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:46.668031 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:46.671630 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 26/50] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:46.677170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7784d-40b0-421d-ad59-c3af83db8f91 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:46.725234 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742789e-91a5-4d25-b2e1-fd24b73a5bd2 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:46.725532 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742789e-91a5-4d25-b2e1-fd24b73a5bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:46.725815 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742789e-91a5-4d25-b2e1-fd24b73a5bd2 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:46.727203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 27/51] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:46.732013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b3ea0-723d-4f46-bd2d-e20bed6e1868 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:46.732300 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b3ea0-723d-4f46-bd2d-e20bed6e1868 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:46.732580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b3ea0-723d-4f46-bd2d-e20bed6e1868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:46.749104 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-1e2b3ea0-723d-4f46-bd2d-e20bed6e1868 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:46.750290 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-1e2b3ea0-723d-4f46-bd2d-e20bed6e1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:46.754659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:46.779730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7784d-40b0-421d-ad59-c3af83db8f91 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:46.813726 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bafb8f-7e3e-4595-9f70-8a3d78b4a5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:46.814636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bafb8f-7e3e-4595-9f70-8a3d78b4a5df None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:46.814932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bafb8f-7e3e-4595-9f70-8a3d78b4a5df None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:46.815215 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bafb8f-7e3e-4595-9f70-8a3d78b4a5df None admin] PATH_INFO: `/v3/users/d63265941a9946a497001fc63bf2b23c` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:46.816067 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 28/52] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:55:46.816420 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bafb8f-7e3e-4595-9f70-8a3d78b4a5df None admin] RBAC: Authorizing `identity:get_user(user_id=d63265941a9946a497001fc63bf2b23c)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:46.817893 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bafb8f-7e3e-4595-9f70-8a3d78b4a5df None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:46.824207 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 25/53] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:55:46 2022] GET /identity/v3/users/d63265941a9946a497001fc63bf2b23c => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:46.825225 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b3ea0-723d-4f46-bd2d-e20bed6e1868 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:46.840823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bafb8f-7e3e-4595-9f70-8a3d78b4a5df None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:46.923842 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b3ea0-723d-4f46-bd2d-e20bed6e1868 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:46.941744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bafb8f-7e3e-4595-9f70-8a3d78b4a5df None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:46.953578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:46.959517 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5395178-b5c7-4a01-9299-169082113ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:46.964095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5395178-b5c7-4a01-9299-169082113ebc None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:46.964095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5395178-b5c7-4a01-9299-169082113ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:46.964095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5395178-b5c7-4a01-9299-169082113ebc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:46.964095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5395178-b5c7-4a01-9299-169082113ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:46.964095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5395178-b5c7-4a01-9299-169082113ebc None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:46.965199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:46.970841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5395178-b5c7-4a01-9299-169082113ebc None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:46.975637 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742899f-1a65-48e3-a9f2-ded829cd90ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:46.976437 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742899f-1a65-48e3-a9f2-ded829cd90ed None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:46.976728 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742899f-1a65-48e3-a9f2-ded829cd90ed None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:46.977013 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742899f-1a65-48e3-a9f2-ded829cd90ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:46.978520 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742899f-1a65-48e3-a9f2-ded829cd90ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:46.979978 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742899f-1a65-48e3-a9f2-ded829cd90ed None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:46.981601 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 26/55] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:46.987944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742899f-1a65-48e3-a9f2-ded829cd90ed None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:47.003299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:47.078221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5395178-b5c7-4a01-9299-169082113ebc None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:47.093010 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742899f-1a65-48e3-a9f2-ded829cd90ed None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:47.113537 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad8d99-5c33-44cd-b1fb-06155a1a45e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:47.114190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8d99-5c33-44cd-b1fb-06155a1a45e9 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:47.114510 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8d99-5c33-44cd-b1fb-06155a1a45e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:47.114795 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8d99-5c33-44cd-b1fb-06155a1a45e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:47.115624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad8d99-5c33-44cd-b1fb-06155a1a45e9 None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.domain.id=default, user.id=d63265941a9946a497001fc63bf2b23c) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:47.115939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad8d99-5c33-44cd-b1fb-06155a1a45e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:47.117387 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad8d99-5c33-44cd-b1fb-06155a1a45e9 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:47.127170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ac48d-e75c-488c-af7b-3d7cd29c4763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:47.127832 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ac48d-e75c-488c-af7b-3d7cd29c4763 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:47.128120 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ac48d-e75c-488c-af7b-3d7cd29c4763 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:47.128404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ac48d-e75c-488c-af7b-3d7cd29c4763 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:47.131410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ac48d-e75c-488c-af7b-3d7cd29c4763 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:47.131410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ac48d-e75c-488c-af7b-3d7cd29c4763 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:47.191223 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 30/56] 10.222.0.42 () {56 vars in 1322 bytes} [Mon Jun 6 06:55:46 2022] GET /identity/v3/role_assignments?user.id=d63265941a9946a497001fc63bf2b23c&scope.domain.id=default&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 530 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:47.334194 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 27/57] 10.222.0.42 () {60 vars in 1140 bytes} [Mon Jun 6 06:55:46 2022] POST /identity/v3/projects => generated 298 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:55:49.648626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f39d75-4007-4d63-b654-8b1f5316e1ab None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:49.649140 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f39d75-4007-4d63-b654-8b1f5316e1ab None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:49.649222 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f39d75-4007-4d63-b654-8b1f5316e1ab None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:49.650629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 31/58] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:49.655886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158390e-b8ed-413a-8795-2d7fa36c0e13 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:49.656302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158390e-b8ed-413a-8795-2d7fa36c0e13 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:49.656468 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158390e-b8ed-413a-8795-2d7fa36c0e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:49.672909 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-4158390e-b8ed-413a-8795-2d7fa36c0e13 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:49.674094 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-4158390e-b8ed-413a-8795-2d7fa36c0e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:49.729099 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:49.738965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:49.765403 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f39d75-4007-4d63-b654-8b1f5316e1ab None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:49.826711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:49.864284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f39d75-4007-4d63-b654-8b1f5316e1ab None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:49.897397 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7330b-3cae-4f3d-8857-07a4fe4eafde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:49.898181 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7330b-3cae-4f3d-8857-07a4fe4eafde None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:49.898505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7330b-3cae-4f3d-8857-07a4fe4eafde None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:49.898837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7330b-3cae-4f3d-8857-07a4fe4eafde None admin] PATH_INFO: `/v3/domains/default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:49.900046 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7330b-3cae-4f3d-8857-07a4fe4eafde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:49.901501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7330b-3cae-4f3d-8857-07a4fe4eafde None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:49.903141 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 32/60] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:49.908530 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158390e-b8ed-413a-8795-2d7fa36c0e13 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:50.005021 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158390e-b8ed-413a-8795-2d7fa36c0e13 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:50.038579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227660-77cd-4ee6-abe9-ab766f46992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:50.039248 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227660-77cd-4ee6-abe9-ab766f46992f None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:50.039540 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227660-77cd-4ee6-abe9-ab766f46992f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:50.039823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227660-77cd-4ee6-abe9-ab766f46992f None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:50.041042 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89227660-77cd-4ee6-abe9-ab766f46992f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:50.042517 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89227660-77cd-4ee6-abe9-ab766f46992f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:50.120621 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 29/61] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:55:49 2022] POST /identity/v3/users => generated 275 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:55:53.528569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d16a-20b7-4931-aca2-4400c1016cd4 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:53.529081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d16a-20b7-4931-aca2-4400c1016cd4 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:53.529153 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d16a-20b7-4931-aca2-4400c1016cd4 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:53.530543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 33/62] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:53.548224 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3a1b7-a08a-4f8e-847b-84a7e257db9d None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:53.549068 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3a1b7-a08a-4f8e-847b-84a7e257db9d None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:53.549502 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3a1b7-a08a-4f8e-847b-84a7e257db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:53.571428 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-58a3a1b7-a08a-4f8e-847b-84a7e257db9d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:53.572911 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-58a3a1b7-a08a-4f8e-847b-84a7e257db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:53.628653 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:53.668943 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:53.710550 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036d16a-20b7-4931-aca2-4400c1016cd4 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:53.815096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497898d1-feb6-4ff0-acda-d54d28725051 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:53.815721 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497898d1-feb6-4ff0-acda-d54d28725051 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:53.816223 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497898d1-feb6-4ff0-acda-d54d28725051 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:53.817812 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 31/64] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:55:53.827703 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8239bd7-0c11-4a7c-9244-148a176e1a7f None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:53.828284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8239bd7-0c11-4a7c-9244-148a176e1a7f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:53.828785 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8239bd7-0c11-4a7c-9244-148a176e1a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:53.845994 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-a8239bd7-0c11-4a7c-9244-148a176e1a7f None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:53.847556 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-a8239bd7-0c11-4a7c-9244-148a176e1a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:53.865587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036d16a-20b7-4931-aca2-4400c1016cd4 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:53.925095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:53.934862 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c316971-377f-481e-90fd-9f5846527071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:53.935715 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c316971-377f-481e-90fd-9f5846527071 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:53.936006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c316971-377f-481e-90fd-9f5846527071 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:53.936290 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c316971-377f-481e-90fd-9f5846527071 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:53.959254 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c316971-377f-481e-90fd-9f5846527071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-8c316971-377f-481e-90fd-9f5846527071 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:55:53.973308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:53.974240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:55:53.975546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 34/65] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:55:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:55:53.979381 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 32/66] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:55:53.981748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c316971-377f-481e-90fd-9f5846527071 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.005380 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8239bd7-0c11-4a7c-9244-148a176e1a7f None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.112395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c316971-377f-481e-90fd-9f5846527071 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:54.135974 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8239bd7-0c11-4a7c-9244-148a176e1a7f None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:54.146187 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:54.158816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26685634-2db0-4f3b-8466-88498430bdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:54.159790 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26685634-2db0-4f3b-8466-88498430bdbe None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.160296 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26685634-2db0-4f3b-8466-88498430bdbe None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.160734 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26685634-2db0-4f3b-8466-88498430bdbe None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.164868 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26685634-2db0-4f3b-8466-88498430bdbe None admin] RBAC: Adding query filter params (name=member) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:54.164868 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26685634-2db0-4f3b-8466-88498430bdbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:54.164868 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26685634-2db0-4f3b-8466-88498430bdbe None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:54.173034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 35/67] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:55:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:54.174711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1b44-9849-44cf-9083-283c757240da None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.175225 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1b44-9849-44cf-9083-283c757240da None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.175488 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951ca4c-bdf9-43bb-b3a2-a13c2a83d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:54.175982 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1b44-9849-44cf-9083-283c757240da None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.176371 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ca4c-bdf9-43bb-b3a2-a13c2a83d183 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.176669 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ca4c-bdf9-43bb-b3a2-a13c2a83d183 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.176957 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ca4c-bdf9-43bb-b3a2-a13c2a83d183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.178183 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 36/68] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:54.179321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba1b44-9849-44cf-9083-283c757240da None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.198358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951ca4c-bdf9-43bb-b3a2-a13c2a83d183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-6951ca4c-bdf9-43bb-b3a2-a13c2a83d183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:55:54.210730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:54.211606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:55:54.212921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 33/69] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:55:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:55:54.218470 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa399df-ea0e-4e00-8c2a-573162d9d9f3 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.218470 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa399df-ea0e-4e00-8c2a-573162d9d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.218470 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa399df-ea0e-4e00-8c2a-573162d9d9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.238520 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-eaa399df-ea0e-4e00-8c2a-573162d9d9f3 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:54.239739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-eaa399df-ea0e-4e00-8c2a-573162d9d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:54.269895 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:54.313226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 34/70] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:54.315260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa399df-ea0e-4e00-8c2a-573162d9d9f3 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.333045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba1b44-9849-44cf-9083-283c757240da None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:54.368640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358b5b7-f378-417a-ae27-5f5d50b4cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:54.369450 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358b5b7-f378-417a-ae27-5f5d50b4cbcc None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.369751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358b5b7-f378-417a-ae27-5f5d50b4cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.370039 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358b5b7-f378-417a-ae27-5f5d50b4cbcc None admin] PATH_INFO: `/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.383419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358b5b7-f378-417a-ae27-5f5d50b4cbcc None admin] RBAC: Authorizing `identity:get_user(user_id=7840bfcb9b9443cc92e2e8f6e347f9b9)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:54.384913 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358b5b7-f378-417a-ae27-5f5d50b4cbcc None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:54.386611 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 37/71] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:55:54 2022] GET /identity/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:54.387814 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceef89-3a1c-4d63-8d40-8169bae1e696 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.388108 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceef89-3a1c-4d63-8d40-8169bae1e696 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.388392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceef89-3a1c-4d63-8d40-8169bae1e696 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.393619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 38/72] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:54.393619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dd58f-6bf0-4d9c-a062-e40d4c9bd289 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.393619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dd58f-6bf0-4d9c-a062-e40d4c9bd289 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.393619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dd58f-6bf0-4d9c-a062-e40d4c9bd289 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.393619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 39/73] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:54.393619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dd58f-6bf0-4d9c-a062-e40d4c9bd289 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.425232 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:54.429000 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa399df-ea0e-4e00-8c2a-573162d9d9f3 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:54.463873 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f400f3-66d0-4c75-aa50-1f952506c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:54.464550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f400f3-66d0-4c75-aa50-1f952506c4cd None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.464841 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f400f3-66d0-4c75-aa50-1f952506c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.465127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f400f3-66d0-4c75-aa50-1f952506c4cd None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.465887 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f400f3-66d0-4c75-aa50-1f952506c4cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:54.466204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f400f3-66d0-4c75-aa50-1f952506c4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:54.467661 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f400f3-66d0-4c75-aa50-1f952506c4cd None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:54.475819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 35/74] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:55:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:54.476645 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f400f3-66d0-4c75-aa50-1f952506c4cd None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.494757 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dd58f-6bf0-4d9c-a062-e40d4c9bd289 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:54.505500 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:54.529412 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7416816-3c94-481e-b226-31814fcc938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:54.530216 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7416816-3c94-481e-b226-31814fcc938c None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.530534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7416816-3c94-481e-b226-31814fcc938c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.530834 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7416816-3c94-481e-b226-31814fcc938c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.541053 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7416816-3c94-481e-b226-31814fcc938c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-d7416816-3c94-481e-b226-31814fcc938c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:55:54.549082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:54.550085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 40/75] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:55:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:55:54.555664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a8ca-cf55-4a93-a88c-5752fd553d13 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.556444 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a8ca-cf55-4a93-a88c-5752fd553d13 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.556444 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a8ca-cf55-4a93-a88c-5752fd553d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.568632 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-ad01a8ca-cf55-4a93-a88c-5752fd553d13 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:54.569800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-ad01a8ca-cf55-4a93-a88c-5752fd553d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:54.577071 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f400f3-66d0-4c75-aa50-1f952506c4cd None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:54.610350 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829f69f-99c3-4259-be63-0aa61aefac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:54.611016 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829f69f-99c3-4259-be63-0aa61aefac26 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.611316 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829f69f-99c3-4259-be63-0aa61aefac26 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.611606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829f69f-99c3-4259-be63-0aa61aefac26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.642569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:54.655484 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 41/76] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:54.674013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb5e5-d924-4ad5-8eb2-33876baff237 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.674013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb5e5-d924-4ad5-8eb2-33876baff237 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.674013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebb5e5-d924-4ad5-8eb2-33876baff237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.682978 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829f69f-99c3-4259-be63-0aa61aefac26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:54.684474 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829f69f-99c3-4259-be63-0aa61aefac26 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:54.686087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-00ebb5e5-d924-4ad5-8eb2-33876baff237 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:54.687386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-00ebb5e5-d924-4ad5-8eb2-33876baff237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:54.753314 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 42/77] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:54.754007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebb5e5-d924-4ad5-8eb2-33876baff237 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.783867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 36/78] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:55:54.785423 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:54.789049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829f69f-99c3-4259-be63-0aa61aefac26 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.848272 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:54.853251 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebb5e5-d924-4ad5-8eb2-33876baff237 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:54.887451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de2a4-a655-4e4d-9fdb-cd916d73f15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:54.888334 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de2a4-a655-4e4d-9fdb-cd916d73f15b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.888622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de2a4-a655-4e4d-9fdb-cd916d73f15b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.888904 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de2a4-a655-4e4d-9fdb-cd916d73f15b None admin] PATH_INFO: `/v3/users/d63265941a9946a497001fc63bf2b23c` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.889466 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829f69f-99c3-4259-be63-0aa61aefac26 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:54.890101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de2a4-a655-4e4d-9fdb-cd916d73f15b None admin] RBAC: Authorizing `identity:get_user(user_id=d63265941a9946a497001fc63bf2b23c)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:54.891610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de2a4-a655-4e4d-9fdb-cd916d73f15b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:54.893451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 43/79] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:55:54 2022] GET /identity/v3/users/d63265941a9946a497001fc63bf2b23c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:54.894078 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de2a4-a655-4e4d-9fdb-cd916d73f15b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.925773 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda67d6-c92c-4c2a-beeb-caa7e73a68a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:54.926493 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda67d6-c92c-4c2a-beeb-caa7e73a68a2 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:54.926788 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda67d6-c92c-4c2a-beeb-caa7e73a68a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:54.927070 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda67d6-c92c-4c2a-beeb-caa7e73a68a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:54.927823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda67d6-c92c-4c2a-beeb-caa7e73a68a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:54.928133 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda67d6-c92c-4c2a-beeb-caa7e73a68a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:54.929504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda67d6-c92c-4c2a-beeb-caa7e73a68a2 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:54.938109 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 37/80] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:55:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:54.938981 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda67d6-c92c-4c2a-beeb-caa7e73a68a2 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:54.994249 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:54.998167 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de2a4-a655-4e4d-9fdb-cd916d73f15b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.033832 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aa179-2fdd-4730-86b6-5001da4fe611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.035093 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aa179-2fdd-4730-86b6-5001da4fe611 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.035387 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aa179-2fdd-4730-86b6-5001da4fe611 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.035676 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aa179-2fdd-4730-86b6-5001da4fe611 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.036856 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aa179-2fdd-4730-86b6-5001da4fe611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:55.038303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aa179-2fdd-4730-86b6-5001da4fe611 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:55.045343 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 44/81] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:55.045343 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aa179-2fdd-4730-86b6-5001da4fe611 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:55.050554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda67d6-c92c-4c2a-beeb-caa7e73a68a2 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.075522 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:55.086739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0732d1-d7c3-44a8-9a7c-d07772b27a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.087568 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0732d1-d7c3-44a8-9a7c-d07772b27a34 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.087856 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0732d1-d7c3-44a8-9a7c-d07772b27a34 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.088140 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0732d1-d7c3-44a8-9a7c-d07772b27a34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.098417 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0732d1-d7c3-44a8-9a7c-d07772b27a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-cd0732d1-d7c3-44a8-9a7c-d07772b27a34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:55:55.106324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:55.107193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:55:55.107944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:55:55.110496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 38/82] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:55:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:55:55.111337 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0732d1-d7c3-44a8-9a7c-d07772b27a34 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:55.141165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aa179-2fdd-4730-86b6-5001da4fe611 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.174939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d854f-a6a5-4784-9374-6ddfd0774d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.175741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d854f-a6a5-4784-9374-6ddfd0774d77 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.176034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d854f-a6a5-4784-9374-6ddfd0774d77 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.176322 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d854f-a6a5-4784-9374-6ddfd0774d77 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.177525 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d854f-a6a5-4784-9374-6ddfd0774d77 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:55.179025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d854f-a6a5-4784-9374-6ddfd0774d77 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:55.180722 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 45/83] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:55:55 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:55.182052 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d854f-a6a5-4784-9374-6ddfd0774d77 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:55.215432 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0732d1-d7c3-44a8-9a7c-d07772b27a34 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.215935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:55.249363 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7af0d-9dd6-4075-abb4-e05af6933005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.250022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7af0d-9dd6-4075-abb4-e05af6933005 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.250323 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7af0d-9dd6-4075-abb4-e05af6933005 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.250637 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7af0d-9dd6-4075-abb4-e05af6933005 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.281051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d854f-a6a5-4784-9374-6ddfd0774d77 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.301342 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:55.315258 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6248ec7-6121-46af-8794-9ee136185bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.316187 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6248ec7-6121-46af-8794-9ee136185bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.316480 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6248ec7-6121-46af-8794-9ee136185bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.316766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6248ec7-6121-46af-8794-9ee136185bd5 None admin] PATH_INFO: `/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.317965 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6248ec7-6121-46af-8794-9ee136185bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=7840bfcb9b9443cc92e2e8f6e347f9b9)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:55.319456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6248ec7-6121-46af-8794-9ee136185bd5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:55.320082 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7af0d-9dd6-4075-abb4-e05af6933005 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:55.321363 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 46/84] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:55:55 2022] GET /identity/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:55.321904 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6248ec7-6121-46af-8794-9ee136185bd5 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:55.322083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7af0d-9dd6-4075-abb4-e05af6933005 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:55.421068 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6248ec7-6121-46af-8794-9ee136185bd5 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.422622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:55.424549 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 39/85] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:55:55.430146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7af0d-9dd6-4075-abb4-e05af6933005 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:55.456595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad21b9a-aab3-4493-bdcc-6f451f1e45bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.457276 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad21b9a-aab3-4493-bdcc-6f451f1e45bc None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.457566 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad21b9a-aab3-4493-bdcc-6f451f1e45bc None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.457851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad21b9a-aab3-4493-bdcc-6f451f1e45bc None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.458610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad21b9a-aab3-4493-bdcc-6f451f1e45bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:55.460089 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad21b9a-aab3-4493-bdcc-6f451f1e45bc None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:55.506247 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:55.523158 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7af0d-9dd6-4075-abb4-e05af6933005 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.532044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 47/86] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:55:55 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:55:55.532854 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad21b9a-aab3-4493-bdcc-6f451f1e45bc None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:55.572032 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904ff8-c96b-4e95-a2ce-78d20860da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.572890 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904ff8-c96b-4e95-a2ce-78d20860da0e None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.574014 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904ff8-c96b-4e95-a2ce-78d20860da0e None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.574014 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904ff8-c96b-4e95-a2ce-78d20860da0e None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.574408 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d904ff8-c96b-4e95-a2ce-78d20860da0e None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:55.574733 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d904ff8-c96b-4e95-a2ce-78d20860da0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:55.576195 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d904ff8-c96b-4e95-a2ce-78d20860da0e None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:55.586103 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 40/87] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:55:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:55.587179 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904ff8-c96b-4e95-a2ce-78d20860da0e None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:55.655750 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad21b9a-aab3-4493-bdcc-6f451f1e45bc None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.693456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd6989-5efd-43a8-b153-6a4dff37bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.694053 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd6989-5efd-43a8-b153-6a4dff37bc40 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.694364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd6989-5efd-43a8-b153-6a4dff37bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.694649 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd6989-5efd-43a8-b153-6a4dff37bc40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.695497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd6989-5efd-43a8-b153-6a4dff37bc40 None admin] RBAC: Adding query filter params (role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5, user.id=7840bfcb9b9443cc92e2e8f6e347f9b9) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:55.695809 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd6989-5efd-43a8-b153-6a4dff37bc40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:55.697357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd6989-5efd-43a8-b153-6a4dff37bc40 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:55.698977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904ff8-c96b-4e95-a2ce-78d20860da0e None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.704361 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 48/88] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:55:55 2022] GET /identity/v3/role_assignments?user.id=7840bfcb9b9443cc92e2e8f6e347f9b9&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:55.704361 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd6989-5efd-43a8-b153-6a4dff37bc40 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:55.742826 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca4d70-2f39-4248-9027-d30cab494c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.743539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca4d70-2f39-4248-9027-d30cab494c00 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.743832 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca4d70-2f39-4248-9027-d30cab494c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.744120 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca4d70-2f39-4248-9027-d30cab494c00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.748262 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:55.764239 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:55.844727 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca4d70-2f39-4248-9027-d30cab494c00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:55.847848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca4d70-2f39-4248-9027-d30cab494c00 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:55.859650 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd6989-5efd-43a8-b153-6a4dff37bc40 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:55.919283 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8001555-7c56-44cc-8cef-6f26d551676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:55.920239 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8001555-7c56-44cc-8cef-6f26d551676f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:55.920530 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8001555-7c56-44cc-8cef-6f26d551676f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:55.920820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8001555-7c56-44cc-8cef-6f26d551676f None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:55.923811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8001555-7c56-44cc-8cef-6f26d551676f None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:55.925406 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8001555-7c56-44cc-8cef-6f26d551676f None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:55.928222 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 49/89] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:55:55 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:55.929542 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8001555-7c56-44cc-8cef-6f26d551676f None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:56.020312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 41/90] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:55:56.022539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca4d70-2f39-4248-9027-d30cab494c00 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:56.078759 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:56.083882 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8001555-7c56-44cc-8cef-6f26d551676f None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:56.092967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:56.122490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf3397-7fbb-4696-8b96-8c74d4e82276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:56.123718 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf3397-7fbb-4696-8b96-8c74d4e82276 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:56.124203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf3397-7fbb-4696-8b96-8c74d4e82276 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:56.124675 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf3397-7fbb-4696-8b96-8c74d4e82276 None admin] PATH_INFO: `/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:56.126418 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf3397-7fbb-4696-8b96-8c74d4e82276 None admin] RBAC: Authorizing `identity:get_user(user_id=7840bfcb9b9443cc92e2e8f6e347f9b9)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:56.128099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf3397-7fbb-4696-8b96-8c74d4e82276 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:56.129977 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 50/91] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:55:55 2022] GET /identity/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:56.131112 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf3397-7fbb-4696-8b96-8c74d4e82276 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:56.161441 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca4d70-2f39-4248-9027-d30cab494c00 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:56.200463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eda220-5a2e-44bb-9c33-d19ceccc3cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:56.201128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda220-5a2e-44bb-9c33-d19ceccc3cc6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:56.201422 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda220-5a2e-44bb-9c33-d19ceccc3cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:56.201704 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eda220-5a2e-44bb-9c33-d19ceccc3cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:56.202583 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eda220-5a2e-44bb-9c33-d19ceccc3cc6 None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5, user.id=d63265941a9946a497001fc63bf2b23c) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:56.210353 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eda220-5a2e-44bb-9c33-d19ceccc3cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:56.210353 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eda220-5a2e-44bb-9c33-d19ceccc3cc6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:56.213799 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 42/92] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:55:56 2022] GET /identity/v3/role_assignments?user.id=d63265941a9946a497001fc63bf2b23c&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:56.215283 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eda220-5a2e-44bb-9c33-d19ceccc3cc6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:56.354026 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf3397-7fbb-4696-8b96-8c74d4e82276 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:56.397782 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eda220-5a2e-44bb-9c33-d19ceccc3cc6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:56.423352 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:56.457550 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225e14a-0da3-491f-9a28-8b07a0145488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:56.458722 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225e14a-0da3-491f-9a28-8b07a0145488 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:56.458963 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225e14a-0da3-491f-9a28-8b07a0145488 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:56.459410 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225e14a-0da3-491f-9a28-8b07a0145488 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:56.460694 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225e14a-0da3-491f-9a28-8b07a0145488 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:56.462787 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225e14a-0da3-491f-9a28-8b07a0145488 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:56.464953 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 51/93] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:55:56 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:56.473071 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225e14a-0da3-491f-9a28-8b07a0145488 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:56.473623 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546dd08-f916-4d31-b368-6bd7d9bbdb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:56.474300 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546dd08-f916-4d31-b368-6bd7d9bbdb2c None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:56.474621 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546dd08-f916-4d31-b368-6bd7d9bbdb2c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:56.474910 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546dd08-f916-4d31-b368-6bd7d9bbdb2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:56.505555 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:56.586739 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225e14a-0da3-491f-9a28-8b07a0145488 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:56.615562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546dd08-f916-4d31-b368-6bd7d9bbdb2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:56.617114 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546dd08-f916-4d31-b368-6bd7d9bbdb2c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:56.624778 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba39fa-0ae3-4e62-9d03-169cff9ddc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:56.625491 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba39fa-0ae3-4e62-9d03-169cff9ddc5d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:56.626161 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba39fa-0ae3-4e62-9d03-169cff9ddc5d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:56.626464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba39fa-0ae3-4e62-9d03-169cff9ddc5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:56.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba39fa-0ae3-4e62-9d03-169cff9ddc5d None admin] RBAC: Adding query filter params (role.id=33a7efc2edd44d81bc33bfd6d02c61cb, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5, user.id=7840bfcb9b9443cc92e2e8f6e347f9b9) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:56.627670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba39fa-0ae3-4e62-9d03-169cff9ddc5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:56.629441 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba39fa-0ae3-4e62-9d03-169cff9ddc5d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:56.636253 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 52/94] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:55:56 2022] GET /identity/v3/role_assignments?user.id=7840bfcb9b9443cc92e2e8f6e347f9b9&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=33a7efc2edd44d81bc33bfd6d02c61cb => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:56.774954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 43/95] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:55:56.780627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba39fa-0ae3-4e62-9d03-169cff9ddc5d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:56.884730 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:56.894867 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba39fa-0ae3-4e62-9d03-169cff9ddc5d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:56.932715 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f45024-d42f-44d0-bd9f-740150edbbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:56.933616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f45024-d42f-44d0-bd9f-740150edbbf4 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:56.934509 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f45024-d42f-44d0-bd9f-740150edbbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:56.934793 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f45024-d42f-44d0-bd9f-740150edbbf4 None admin] PATH_INFO: `/v3/projects/8ccd732f0ae14646a9417241b049a995` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:56.936047 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f45024-d42f-44d0-bd9f-740150edbbf4 None admin] RBAC: Authorizing `identity:get_project(project_id=8ccd732f0ae14646a9417241b049a995)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:56.937648 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f45024-d42f-44d0-bd9f-740150edbbf4 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:56.940097 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 53/96] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:55:56 2022] GET /identity/v3/projects/8ccd732f0ae14646a9417241b049a995 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:55:56.951506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546dd08-f916-4d31-b368-6bd7d9bbdb2c None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:56.962702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:57.097251 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546dd08-f916-4d31-b368-6bd7d9bbdb2c None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:57.148040 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666856be-3583-4fab-be90-176f17b7c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:57.149038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666856be-3583-4fab-be90-176f17b7c961 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:57.150068 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666856be-3583-4fab-be90-176f17b7c961 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:57.150578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666856be-3583-4fab-be90-176f17b7c961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:57.151616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666856be-3583-4fab-be90-176f17b7c961 None admin] RBAC: Adding query filter params (role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=8ccd732f0ae14646a9417241b049a995, user.id=7840bfcb9b9443cc92e2e8f6e347f9b9) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:57.152155 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666856be-3583-4fab-be90-176f17b7c961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:57.153815 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666856be-3583-4fab-be90-176f17b7c961 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:57.162346 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 44/97] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:55:56 2022] GET /identity/v3/role_assignments?user.id=7840bfcb9b9443cc92e2e8f6e347f9b9&scope.project.id=8ccd732f0ae14646a9417241b049a995&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:58.943557 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71596b-71b0-4af8-92a2-c3a33a8475d2 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:58.945347 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71596b-71b0-4af8-92a2-c3a33a8475d2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:58.945347 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71596b-71b0-4af8-92a2-c3a33a8475d2 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:58.945687 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 54/98] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:58.951586 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2308f8c-b8a0-464d-acd0-21bdfb5b4aa2 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:58.952025 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2308f8c-b8a0-464d-acd0-21bdfb5b4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:58.952196 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2308f8c-b8a0-464d-acd0-21bdfb5b4aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:58.975325 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-b2308f8c-b8a0-464d-acd0-21bdfb5b4aa2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:58.976557 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-b2308f8c-b8a0-464d-acd0-21bdfb5b4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:59.051107 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 45/99] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:59.075510 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71596b-71b0-4af8-92a2-c3a33a8475d2 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:59.100620 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6999e1b-8f16-4156-a8db-60576d36c1d7 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.101278 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6999e1b-8f16-4156-a8db-60576d36c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.101770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6999e1b-8f16-4156-a8db-60576d36c1d7 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.103649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 46/100] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:59.110507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a885bc-b288-41f5-b216-bf952a6d60f3 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.111238 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a885bc-b288-41f5-b216-bf952a6d60f3 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.114966 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a885bc-b288-41f5-b216-bf952a6d60f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.121570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:59.142716 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-c0a885bc-b288-41f5-b216-bf952a6d60f3 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:59.150707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-c0a885bc-b288-41f5-b216-bf952a6d60f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:59.252876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71596b-71b0-4af8-92a2-c3a33a8475d2 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:59.282219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 47/101] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:59.309034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ff2f0-3856-4d2e-87ca-34a94f4ad28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:59.309923 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff2f0-3856-4d2e-87ca-34a94f4ad28d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.310268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff2f0-3856-4d2e-87ca-34a94f4ad28d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.310784 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff2f0-3856-4d2e-87ca-34a94f4ad28d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.327554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a885bc-b288-41f5-b216-bf952a6d60f3 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:59.331086 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ff2f0-3856-4d2e-87ca-34a94f4ad28d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-0f4ff2f0-3856-4d2e-87ca-34a94f4ad28d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:55:59.356010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:59.356962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:55:59.357810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:55:59.360788 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 55/102] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:55:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:55:59.362986 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9a338-7709-4dda-ab22-4c4ce3baead3 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.363468 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9a338-7709-4dda-ab22-4c4ce3baead3 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.363906 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9a338-7709-4dda-ab22-4c4ce3baead3 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.365567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 56/103] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:55:59.366460 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9a338-7709-4dda-ab22-4c4ce3baead3 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:59.394019 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:59.483829 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9a338-7709-4dda-ab22-4c4ce3baead3 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:59.528233 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aacbe-ddec-462e-a98e-eb04e39f9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:59.529267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aacbe-ddec-462e-a98e-eb04e39f9148 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.529766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aacbe-ddec-462e-a98e-eb04e39f9148 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.530261 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aacbe-ddec-462e-a98e-eb04e39f9148 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.531256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aacbe-ddec-462e-a98e-eb04e39f9148 None admin] RBAC: Adding query filter params (name=member) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:59.532928 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aacbe-ddec-462e-a98e-eb04e39f9148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:59.534567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aacbe-ddec-462e-a98e-eb04e39f9148 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:59.546085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 57/104] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:55:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:59.551046 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a885bc-b288-41f5-b216-bf952a6d60f3 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:59.557135 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1b9c-7030-4cf4-81d1-f6a6180b6052 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.557135 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1b9c-7030-4cf4-81d1-f6a6180b6052 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.557135 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1b9c-7030-4cf4-81d1-f6a6180b6052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.570299 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-e97f1b9c-7030-4cf4-81d1-f6a6180b6052 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:55:59.571946 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-e97f1b9c-7030-4cf4-81d1-f6a6180b6052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:55:59.586548 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:59.593235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc89eb-6629-4494-81f4-9dc2e6cb273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:59.594054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc89eb-6629-4494-81f4-9dc2e6cb273a None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.594363 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc89eb-6629-4494-81f4-9dc2e6cb273a None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.594661 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc89eb-6629-4494-81f4-9dc2e6cb273a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.608886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc89eb-6629-4494-81f4-9dc2e6cb273a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-4abc89eb-6629-4494-81f4-9dc2e6cb273a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:55:59.618595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:55:59.619561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:55:59.620317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 48/105] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:55:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:55:59.620968 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc89eb-6629-4494-81f4-9dc2e6cb273a None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:59.667975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 58/106] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:55:59.669158 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f1b9c-7030-4cf4-81d1-f6a6180b6052 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:59.692966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:59.758316 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc89eb-6629-4494-81f4-9dc2e6cb273a None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:59.797288 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edc1f8-682b-4f81-bf99-40bc71752004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:59.798116 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edc1f8-682b-4f81-bf99-40bc71752004 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.798507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edc1f8-682b-4f81-bf99-40bc71752004 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.798784 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edc1f8-682b-4f81-bf99-40bc71752004 None admin] PATH_INFO: `/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.800124 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edc1f8-682b-4f81-bf99-40bc71752004 None admin] RBAC: Authorizing `identity:get_user(user_id=7840bfcb9b9443cc92e2e8f6e347f9b9)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:59.801640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edc1f8-682b-4f81-bf99-40bc71752004 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:59.803640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 49/107] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:55:59 2022] GET /identity/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:59.804219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edc1f8-682b-4f81-bf99-40bc71752004 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:59.876495 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:55:59.923938 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edc1f8-682b-4f81-bf99-40bc71752004 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:59.953634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f1b9c-7030-4cf4-81d1-f6a6180b6052 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:55:59.965595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d74d-ceb4-4a7c-9d84-12923cc99567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:59.967452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d74d-ceb4-4a7c-9d84-12923cc99567 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.968012 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d74d-ceb4-4a7c-9d84-12923cc99567 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.968454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d74d-ceb4-4a7c-9d84-12923cc99567 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.969972 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53d74d-ceb4-4a7c-9d84-12923cc99567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:59.972256 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53d74d-ceb4-4a7c-9d84-12923cc99567 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:55:59.974538 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 50/108] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:55:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:55:59.975465 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d74d-ceb4-4a7c-9d84-12923cc99567 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:55:59.991357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396d971-4c48-4e5a-96b0-df1cb2788e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:55:59.992286 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396d971-4c48-4e5a-96b0-df1cb2788e72 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:55:59.992806 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396d971-4c48-4e5a-96b0-df1cb2788e72 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:55:59.993439 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396d971-4c48-4e5a-96b0-df1cb2788e72 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:55:59.994481 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396d971-4c48-4e5a-96b0-df1cb2788e72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:55:59.995004 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396d971-4c48-4e5a-96b0-df1cb2788e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:55:59.996635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396d971-4c48-4e5a-96b0-df1cb2788e72 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:00.006112 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 59/109] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:55:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:00.007756 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f824cb-3053-4800-908b-8bf3002328b6 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.008302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f824cb-3053-4800-908b-8bf3002328b6 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.009313 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f824cb-3053-4800-908b-8bf3002328b6 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.010957 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 60/110] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:00.011854 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f824cb-3053-4800-908b-8bf3002328b6 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:00.114302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:00.120188 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d74d-ceb4-4a7c-9d84-12923cc99567 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:00.127278 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f824cb-3053-4800-908b-8bf3002328b6 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:00.157537 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:00.166069 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f10082-f4a3-4c6c-9671-5410fbdf9204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:00.166872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e8d79-5af2-4acd-bf0d-2fded9484a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:00.167267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f10082-f4a3-4c6c-9671-5410fbdf9204 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.169088 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f10082-f4a3-4c6c-9671-5410fbdf9204 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.169198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e8d79-5af2-4acd-bf0d-2fded9484a37 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.169295 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f10082-f4a3-4c6c-9671-5410fbdf9204 None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.169366 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e8d79-5af2-4acd-bf0d-2fded9484a37 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.169366 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e8d79-5af2-4acd-bf0d-2fded9484a37 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.169553 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f10082-f4a3-4c6c-9671-5410fbdf9204 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:00.170376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f10082-f4a3-4c6c-9671-5410fbdf9204 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:00.171058 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e8d79-5af2-4acd-bf0d-2fded9484a37 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:00.173839 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e8d79-5af2-4acd-bf0d-2fded9484a37 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:00.176425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 51/111] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:55:59 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:00.183071 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e8d79-5af2-4acd-bf0d-2fded9484a37 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:00.271968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 61/112] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:56:00 2022] POST /identity/v3/projects => generated 302 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:00.273464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26fcd-02eb-47b0-9564-30668aa728d3 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.273797 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26fcd-02eb-47b0-9564-30668aa728d3 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.274088 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26fcd-02eb-47b0-9564-30668aa728d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.294522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-15c26fcd-02eb-47b0-9564-30668aa728d3 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:00.301202 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-15c26fcd-02eb-47b0-9564-30668aa728d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:00.313679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e8d79-5af2-4acd-bf0d-2fded9484a37 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:00.358293 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9257-d9ad-4827-bf56-09aa2f49fa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:00.359431 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9257-d9ad-4827-bf56-09aa2f49fa00 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.359733 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9257-d9ad-4827-bf56-09aa2f49fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.360024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9257-d9ad-4827-bf56-09aa2f49fa00 None admin] PATH_INFO: `/v3/users/7d0ccd0896914ac48301b71e39cfa14c` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.380835 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 62/113] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:00.381660 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c26fcd-02eb-47b0-9564-30668aa728d3 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:00.382028 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f9257-d9ad-4827-bf56-09aa2f49fa00 None admin] RBAC: Authorizing `identity:get_user(user_id=7d0ccd0896914ac48301b71e39cfa14c)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:00.383561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f9257-d9ad-4827-bf56-09aa2f49fa00 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:00.386872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 52/114] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:00 2022] GET /identity/v3/users/7d0ccd0896914ac48301b71e39cfa14c => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:00.388154 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934a9f8-fa29-4e35-917c-18e04cdd5a1f None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.388447 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934a9f8-fa29-4e35-917c-18e04cdd5a1f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.388735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934a9f8-fa29-4e35-917c-18e04cdd5a1f None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.390011 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 53/115] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:00.395749 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934a9f8-fa29-4e35-917c-18e04cdd5a1f None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:00.447161 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:00.482822 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:00.498604 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c26fcd-02eb-47b0-9564-30668aa728d3 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:00.534845 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934a9f8-fa29-4e35-917c-18e04cdd5a1f None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:00.537834 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57cb79-a66a-417d-ac87-26fc04415575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:00.542462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57cb79-a66a-417d-ac87-26fc04415575 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.542462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57cb79-a66a-417d-ac87-26fc04415575 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.542462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57cb79-a66a-417d-ac87-26fc04415575 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/users/7840bfcb9b9443cc92e2e8f6e347f9b9/roles/030683e4ff8d4d1587d99164f75c0fb8` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.542462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57cb79-a66a-417d-ac87-26fc04415575 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9017adacd6f4b29adabe3bdb6713cc5, user_id=7840bfcb9b9443cc92e2e8f6e347f9b9, role_id=030683e4ff8d4d1587d99164f75c0fb8)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:00.543030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57cb79-a66a-417d-ac87-26fc04415575 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:00.575402 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc3f6b-98d1-4537-a41f-59bcb8bc6ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:00.576128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc3f6b-98d1-4537-a41f-59bcb8bc6ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.576424 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc3f6b-98d1-4537-a41f-59bcb8bc6ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.576713 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc3f6b-98d1-4537-a41f-59bcb8bc6ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.611793 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 63/116] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:56:00 2022] PUT /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/users/7840bfcb9b9443cc92e2e8f6e347f9b9/roles/030683e4ff8d4d1587d99164f75c0fb8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:00.613319 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b51ce9-9f61-4388-a379-07f21db60e37 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.613618 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b51ce9-9f61-4388-a379-07f21db60e37 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.613901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b51ce9-9f61-4388-a379-07f21db60e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.633516 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-55b51ce9-9f61-4388-a379-07f21db60e37 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:00.635213 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-55b51ce9-9f61-4388-a379-07f21db60e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:00.678654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc3f6b-98d1-4537-a41f-59bcb8bc6ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:00.680224 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc3f6b-98d1-4537-a41f-59bcb8bc6ab0 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:00.714777 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 64/117] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:00.715716 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b51ce9-9f61-4388-a379-07f21db60e37 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:00.762455 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:00.767329 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:00.827027 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 54/118] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:00.828516 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35736d6f-ae54-4c5b-bceb-f95a77c931f0 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.828819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35736d6f-ae54-4c5b-bceb-f95a77c931f0 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.829102 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35736d6f-ae54-4c5b-bceb-f95a77c931f0 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.830389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 55/119] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:00.834276 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35736d6f-ae54-4c5b-bceb-f95a77c931f0 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:00.844613 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b51ce9-9f61-4388-a379-07f21db60e37 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:00.894796 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955174a-454d-43c2-8afc-2c23e48e8a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:00.896254 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955174a-454d-43c2-8afc-2c23e48e8a64 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:00.896546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955174a-454d-43c2-8afc-2c23e48e8a64 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:00.896827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955174a-454d-43c2-8afc-2c23e48e8a64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:00.911985 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955174a-454d-43c2-8afc-2c23e48e8a64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-1955174a-454d-43c2-8afc-2c23e48e8a64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:00.921127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:00.922025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:00.923100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 65/120] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:00.923758 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955174a-454d-43c2-8afc-2c23e48e8a64 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:00.964039 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35736d6f-ae54-4c5b-bceb-f95a77c931f0 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.008027 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfef24d-db02-4b17-a9fd-826b08739ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.008938 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfef24d-db02-4b17-a9fd-826b08739ea1 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.009235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfef24d-db02-4b17-a9fd-826b08739ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.009654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfef24d-db02-4b17-a9fd-826b08739ea1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.022946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfef24d-db02-4b17-a9fd-826b08739ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-1bfef24d-db02-4b17-a9fd-826b08739ea1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:01.034231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:01.035157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:01.035936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 56/121] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:01.037400 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423792be-dc23-434c-b6d6-68333e7ca4c4 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.037400 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423792be-dc23-434c-b6d6-68333e7ca4c4 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.037400 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423792be-dc23-434c-b6d6-68333e7ca4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.055592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955174a-454d-43c2-8afc-2c23e48e8a64 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.063117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-423792be-dc23-434c-b6d6-68333e7ca4c4 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:01.064363 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-423792be-dc23-434c-b6d6-68333e7ca4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:01.070462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:01.081671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:01.110723 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32b82-f527-4a26-9b31-76347b7e6036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.111621 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32b82-f527-4a26-9b31-76347b7e6036 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.111990 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32b82-f527-4a26-9b31-76347b7e6036 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.112205 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c32b82-f527-4a26-9b31-76347b7e6036 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.113451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c32b82-f527-4a26-9b31-76347b7e6036 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:01.115032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c32b82-f527-4a26-9b31-76347b7e6036 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:01.117173 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 66/122] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:00 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:01.118456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32b82-f527-4a26-9b31-76347b7e6036 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.164409 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 57/123] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:01.166694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423792be-dc23-434c-b6d6-68333e7ca4c4 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.240962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c32b82-f527-4a26-9b31-76347b7e6036 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.286851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25017-9e42-4d98-b500-255a5804b707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.288240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25017-9e42-4d98-b500-255a5804b707 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.288900 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25017-9e42-4d98-b500-255a5804b707 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.289458 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25017-9e42-4d98-b500-255a5804b707 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.290464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25017-9e42-4d98-b500-255a5804b707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:01.290951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25017-9e42-4d98-b500-255a5804b707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:01.291343 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423792be-dc23-434c-b6d6-68333e7ca4c4 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.292751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25017-9e42-4d98-b500-255a5804b707 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:01.303137 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 67/124] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:01.304107 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25017-9e42-4d98-b500-255a5804b707 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.335316 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea0f9f-6e50-4a56-9aaf-5e694568adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.336814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0f9f-6e50-4a56-9aaf-5e694568adff None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.338150 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0f9f-6e50-4a56-9aaf-5e694568adff None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.338604 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0f9f-6e50-4a56-9aaf-5e694568adff None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.339751 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea0f9f-6e50-4a56-9aaf-5e694568adff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:01.340598 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea0f9f-6e50-4a56-9aaf-5e694568adff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:01.342446 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea0f9f-6e50-4a56-9aaf-5e694568adff None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:01.343753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:01.354382 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 58/125] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:01.355569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea0f9f-6e50-4a56-9aaf-5e694568adff None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.366124 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:01.428191 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25017-9e42-4d98-b500-255a5804b707 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.464896 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061054d9-101a-4897-8495-625051cdae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.465821 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061054d9-101a-4897-8495-625051cdae62 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.466252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061054d9-101a-4897-8495-625051cdae62 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.466710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061054d9-101a-4897-8495-625051cdae62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.467694 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061054d9-101a-4897-8495-625051cdae62 None admin] RBAC: Adding query filter params (role.id=c10458d8928f42bdb48358e0b4ca344e, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5, user.id=7d0ccd0896914ac48301b71e39cfa14c) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:01.468167 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061054d9-101a-4897-8495-625051cdae62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:01.469745 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061054d9-101a-4897-8495-625051cdae62 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:01.470556 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea0f9f-6e50-4a56-9aaf-5e694568adff None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.475895 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 68/126] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:01 2022] GET /identity/v3/role_assignments?user.id=7d0ccd0896914ac48301b71e39cfa14c&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=c10458d8928f42bdb48358e0b4ca344e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:01.476936 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061054d9-101a-4897-8495-625051cdae62 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.510511 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c5c3-6ab2-46bb-81ea-7a47884f784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.511401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c5c3-6ab2-46bb-81ea-7a47884f784f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.515165 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c5c3-6ab2-46bb-81ea-7a47884f784f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.515165 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c5c3-6ab2-46bb-81ea-7a47884f784f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.525920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c5c3-6ab2-46bb-81ea-7a47884f784f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-8a70c5c3-6ab2-46bb-81ea-7a47884f784f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:01.534100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:01.535038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:01.535801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 59/127] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:01.536999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c5c3-6ab2-46bb-81ea-7a47884f784f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.595245 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:01.599565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061054d9-101a-4897-8495-625051cdae62 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.611884 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:01.637057 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0805a-be36-4881-9090-c08015c980a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.638482 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0805a-be36-4881-9090-c08015c980a9 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.645395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0805a-be36-4881-9090-c08015c980a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.645395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0805a-be36-4881-9090-c08015c980a9 None admin] PATH_INFO: `/v3/users/d63265941a9946a497001fc63bf2b23c` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.645395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0805a-be36-4881-9090-c08015c980a9 None admin] RBAC: Authorizing `identity:get_user(user_id=d63265941a9946a497001fc63bf2b23c)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:01.645395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0805a-be36-4881-9090-c08015c980a9 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:01.645395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 69/128] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:01 2022] GET /identity/v3/users/d63265941a9946a497001fc63bf2b23c => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:01.645395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0805a-be36-4881-9090-c08015c980a9 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.652773 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c5c3-6ab2-46bb-81ea-7a47884f784f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.694025 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32393b31-3639-471d-827b-e507ad434cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.695009 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32393b31-3639-471d-827b-e507ad434cbc None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.695427 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32393b31-3639-471d-827b-e507ad434cbc None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.695764 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32393b31-3639-471d-827b-e507ad434cbc None admin] PATH_INFO: `/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.697758 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32393b31-3639-471d-827b-e507ad434cbc None admin] RBAC: Authorizing `identity:get_user(user_id=7840bfcb9b9443cc92e2e8f6e347f9b9)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:01.699443 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32393b31-3639-471d-827b-e507ad434cbc None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:01.701242 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 60/129] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:01 2022] GET /identity/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:01.702122 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32393b31-3639-471d-827b-e507ad434cbc None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.813917 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0805a-be36-4881-9090-c08015c980a9 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.821023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32393b31-3639-471d-827b-e507ad434cbc None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:01.860966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4b9cf-9f80-41e1-992c-f7a0bf9c47a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.862002 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fa2b3-3729-486b-9e85-7a5e5ddd5c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:01.862321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4b9cf-9f80-41e1-992c-f7a0bf9c47a6 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.862824 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4b9cf-9f80-41e1-992c-f7a0bf9c47a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.862925 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fa2b3-3729-486b-9e85-7a5e5ddd5c2e None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:01.863203 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fa2b3-3729-486b-9e85-7a5e5ddd5c2e None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:01.863490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fa2b3-3729-486b-9e85-7a5e5ddd5c2e None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.863849 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4b9cf-9f80-41e1-992c-f7a0bf9c47a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:01.864813 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fa2b3-3729-486b-9e85-7a5e5ddd5c2e None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:01.865091 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4b9cf-9f80-41e1-992c-f7a0bf9c47a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:01.865596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4b9cf-9f80-41e1-992c-f7a0bf9c47a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:01.866342 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fa2b3-3729-486b-9e85-7a5e5ddd5c2e None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:01.867397 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4b9cf-9f80-41e1-992c-f7a0bf9c47a6 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:01.868920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 61/130] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:01 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:01.876409 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fa2b3-3729-486b-9e85-7a5e5ddd5c2e None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.876409 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:01.888169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 70/131] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:01.893681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4b9cf-9f80-41e1-992c-f7a0bf9c47a6 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:01.938753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:02.002713 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fa2b3-3729-486b-9e85-7a5e5ddd5c2e None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:02.044792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a9315-e175-4a8c-a3bb-ccab7c5f6bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:02.045828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a9315-e175-4a8c-a3bb-ccab7c5f6bce None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:02.046274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a9315-e175-4a8c-a3bb-ccab7c5f6bce None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:02.046595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a9315-e175-4a8c-a3bb-ccab7c5f6bce None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:02.047838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a9315-e175-4a8c-a3bb-ccab7c5f6bce None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:02.049298 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a9315-e175-4a8c-a3bb-ccab7c5f6bce None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:02.051120 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 62/132] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:01 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:02.051904 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a9315-e175-4a8c-a3bb-ccab7c5f6bce None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:02.093348 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4b9cf-9f80-41e1-992c-f7a0bf9c47a6 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:02.127683 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:02.153528 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937608d7-1124-4c33-9c4c-5307f5eeee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:02.154461 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937608d7-1124-4c33-9c4c-5307f5eeee88 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:02.162560 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937608d7-1124-4c33-9c4c-5307f5eeee88 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:02.162560 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937608d7-1124-4c33-9c4c-5307f5eeee88 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/users/d63265941a9946a497001fc63bf2b23c/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:02.162560 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937608d7-1124-4c33-9c4c-5307f5eeee88 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9017adacd6f4b29adabe3bdb6713cc5, user_id=d63265941a9946a497001fc63bf2b23c, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:02.162772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a9315-e175-4a8c-a3bb-ccab7c5f6bce None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:02.162843 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937608d7-1124-4c33-9c4c-5307f5eeee88 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:02.196724 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c185b4-d63e-42d5-a954-9d81de84cb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:02.197618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c185b4-d63e-42d5-a954-9d81de84cb58 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:02.197921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c185b4-d63e-42d5-a954-9d81de84cb58 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:02.198220 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c185b4-d63e-42d5-a954-9d81de84cb58 None admin] PATH_INFO: `/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:02.199539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c185b4-d63e-42d5-a954-9d81de84cb58 None admin] RBAC: Authorizing `identity:get_user(user_id=7840bfcb9b9443cc92e2e8f6e347f9b9)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:02.201081 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c185b4-d63e-42d5-a954-9d81de84cb58 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:02.202824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 63/133] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:02 2022] GET /identity/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:02.203579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c185b4-d63e-42d5-a954-9d81de84cb58 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:02.274694 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 71/134] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:56:01 2022] PUT /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/users/d63265941a9946a497001fc63bf2b23c/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:02.275464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937608d7-1124-4c33-9c4c-5307f5eeee88 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:02.313131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c185b4-d63e-42d5-a954-9d81de84cb58 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:02.351934 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb504c-e949-46ae-ad1b-fafc84b483f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:02.353530 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb504c-e949-46ae-ad1b-fafc84b483f7 None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:02.353875 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb504c-e949-46ae-ad1b-fafc84b483f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:02.354156 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb504c-e949-46ae-ad1b-fafc84b483f7 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/users/7840bfcb9b9443cc92e2e8f6e347f9b9/roles/33a7efc2edd44d81bc33bfd6d02c61cb` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:02.356849 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb504c-e949-46ae-ad1b-fafc84b483f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9017adacd6f4b29adabe3bdb6713cc5, user_id=7840bfcb9b9443cc92e2e8f6e347f9b9, role_id=33a7efc2edd44d81bc33bfd6d02c61cb)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:02.358412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb504c-e949-46ae-ad1b-fafc84b483f7 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:02.429389 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:02.447920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:02.453484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 64/135] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:56:02 2022] PUT /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/users/7840bfcb9b9443cc92e2e8f6e347f9b9/roles/33a7efc2edd44d81bc33bfd6d02c61cb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:02.454648 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937608d7-1124-4c33-9c4c-5307f5eeee88 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:02.497376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94c847-1fd6-49f2-bf74-c389338f7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:02.498271 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94c847-1fd6-49f2-bf74-c389338f7578 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:02.498594 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94c847-1fd6-49f2-bf74-c389338f7578 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:02.498879 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94c847-1fd6-49f2-bf74-c389338f7578 None admin] PATH_INFO: `/v3/projects/8ccd732f0ae14646a9417241b049a995` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:02.500210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94c847-1fd6-49f2-bf74-c389338f7578 None admin] RBAC: Authorizing `identity:get_project(project_id=8ccd732f0ae14646a9417241b049a995)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:02.502057 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94c847-1fd6-49f2-bf74-c389338f7578 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:02.503981 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 72/136] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:02 2022] GET /identity/v3/projects/8ccd732f0ae14646a9417241b049a995 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:02.510980 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb504c-e949-46ae-ad1b-fafc84b483f7 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:02.635264 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb504c-e949-46ae-ad1b-fafc84b483f7 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:02.676292 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b5d86-b1ac-4828-8a12-77e1f3851b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:02.677243 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b5d86-b1ac-4828-8a12-77e1f3851b3a None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:02.677534 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b5d86-b1ac-4828-8a12-77e1f3851b3a None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:02.677821 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b5d86-b1ac-4828-8a12-77e1f3851b3a None admin] PATH_INFO: `/v3/projects/8ccd732f0ae14646a9417241b049a995/users/7840bfcb9b9443cc92e2e8f6e347f9b9/roles/030683e4ff8d4d1587d99164f75c0fb8` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:02.680183 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b5d86-b1ac-4828-8a12-77e1f3851b3a None admin] RBAC: Authorizing `identity:create_grant(project_id=8ccd732f0ae14646a9417241b049a995, user_id=7840bfcb9b9443cc92e2e8f6e347f9b9, role_id=030683e4ff8d4d1587d99164f75c0fb8)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:02.681737 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b5d86-b1ac-4828-8a12-77e1f3851b3a None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:02.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 65/137] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:56:02 2022] PUT /identity/v3/projects/8ccd732f0ae14646a9417241b049a995/users/7840bfcb9b9443cc92e2e8f6e347f9b9/roles/030683e4ff8d4d1587d99164f75c0fb8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:03.371645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f19f9-2f12-466b-ab63-6d1bda92e249 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:03.372166 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f19f9-2f12-466b-ab63-6d1bda92e249 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:03.372272 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f19f9-2f12-466b-ab63-6d1bda92e249 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:03.373734 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 73/138] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:03.379287 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015050b-7765-4d10-ab57-6490ac4643fe None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:03.379683 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015050b-7765-4d10-ab57-6490ac4643fe None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:03.379874 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015050b-7765-4d10-ab57-6490ac4643fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:03.407415 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-d015050b-7765-4d10-ab57-6490ac4643fe None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:03.410725 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-d015050b-7765-4d10-ab57-6490ac4643fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:03.489851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:03.507697 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 66/139] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:03.544656 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24b16b-3d05-4a2f-b98e-f0edc983ca36 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:03.544953 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24b16b-3d05-4a2f-b98e-f0edc983ca36 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:03.545235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24b16b-3d05-4a2f-b98e-f0edc983ca36 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:03.546672 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 74/140] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:03.548637 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015050b-7765-4d10-ab57-6490ac4643fe None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:03.551905 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6c60-e217-4c7e-823a-7e895c54334a None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:03.552202 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6c60-e217-4c7e-823a-7e895c54334a None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:03.552486 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f6c60-e217-4c7e-823a-7e895c54334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:03.569735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-c43f6c60-e217-4c7e-823a-7e895c54334a None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:03.570989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-c43f6c60-e217-4c7e-823a-7e895c54334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:03.652000 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 75/141] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:03.681091 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f6c60-e217-4c7e-823a-7e895c54334a None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:03.750910 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015050b-7765-4d10-ab57-6490ac4643fe None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:03.823815 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d3e34-bec6-4e38-a845-5f038ed5c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:03.824631 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3e34-bec6-4e38-a845-5f038ed5c590 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:03.824924 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3e34-bec6-4e38-a845-5f038ed5c590 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:03.825209 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3e34-bec6-4e38-a845-5f038ed5c590 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:03.828923 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d3e34-bec6-4e38-a845-5f038ed5c590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:03.831534 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d3e34-bec6-4e38-a845-5f038ed5c590 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:03.833184 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 67/142] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:03.839344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:03.839491 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d3e34-bec6-4e38-a845-5f038ed5c590 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:03.867107 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f6c60-e217-4c7e-823a-7e895c54334a None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:03.905639 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:03.909006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc868b-65ac-4e4c-b1b0-2e47d239d66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:03.910058 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc868b-65ac-4e4c-b1b0-2e47d239d66f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:03.910585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc868b-65ac-4e4c-b1b0-2e47d239d66f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:03.913909 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc868b-65ac-4e4c-b1b0-2e47d239d66f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:03.937408 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc868b-65ac-4e4c-b1b0-2e47d239d66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-3cfc868b-65ac-4e4c-b1b0-2e47d239d66f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:03.946007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:03.946939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:03.954661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:03.955266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d3e34-bec6-4e38-a845-5f038ed5c590 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:03.957390 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 76/143] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:03.972692 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc868b-65ac-4e4c-b1b0-2e47d239d66f None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:03.995869 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f478b21-bcc2-4d0e-8be5-df9371b5ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:03.996563 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f478b21-bcc2-4d0e-8be5-df9371b5ee3d None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:03.996938 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f478b21-bcc2-4d0e-8be5-df9371b5ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:03.997151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f478b21-bcc2-4d0e-8be5-df9371b5ee3d None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:03.998107 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f478b21-bcc2-4d0e-8be5-df9371b5ee3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:03.999394 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f478b21-bcc2-4d0e-8be5-df9371b5ee3d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:04.128331 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 68/144] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:56:03 2022] POST /identity/v3/users => generated 283 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:04.153566 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc868b-65ac-4e4c-b1b0-2e47d239d66f None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:04.209346 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde29460-3ac4-4715-8478-5effe7692854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:04.210451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde29460-3ac4-4715-8478-5effe7692854 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:04.210945 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde29460-3ac4-4715-8478-5effe7692854 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:04.211425 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde29460-3ac4-4715-8478-5effe7692854 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:04.212475 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde29460-3ac4-4715-8478-5effe7692854 None admin] RBAC: Adding query filter params (name=member) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:04.213030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde29460-3ac4-4715-8478-5effe7692854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:04.214726 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde29460-3ac4-4715-8478-5effe7692854 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:04.224713 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 77/145] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:04.230665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f478b21-bcc2-4d0e-8be5-df9371b5ee3d None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:04.386246 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f478b21-bcc2-4d0e-8be5-df9371b5ee3d None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:04.406667 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:04.428754 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e931f-146c-4977-ba13-b16facc386aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:04.429654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e931f-146c-4977-ba13-b16facc386aa None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:04.429950 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e931f-146c-4977-ba13-b16facc386aa None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:04.430241 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e931f-146c-4977-ba13-b16facc386aa None admin] PATH_INFO: `/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:04.435784 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e931f-146c-4977-ba13-b16facc386aa None admin] RBAC: Authorizing `identity:get_user(user_id=7840bfcb9b9443cc92e2e8f6e347f9b9)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:04.435784 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e931f-146c-4977-ba13-b16facc386aa None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:04.435784 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 69/146] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:04 2022] GET /identity/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:04.441129 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde29460-3ac4-4715-8478-5effe7692854 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:04.467724 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:04.598518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde29460-3ac4-4715-8478-5effe7692854 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:04.643572 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52356f06-7c8b-4d53-8be1-73d8b765a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:04.644591 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356f06-7c8b-4d53-8be1-73d8b765a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:04.645078 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356f06-7c8b-4d53-8be1-73d8b765a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:04.645553 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356f06-7c8b-4d53-8be1-73d8b765a9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:04.700827 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e49ee7-e607-4623-9fbe-b3a8c91d687f None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:04.701156 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e49ee7-e607-4623-9fbe-b3a8c91d687f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:04.701423 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e49ee7-e607-4623-9fbe-b3a8c91d687f None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:04.703075 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 70/147] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:04.711382 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800ada8-7aab-48eb-88f4-ab425ad7b77a None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:04.711681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800ada8-7aab-48eb-88f4-ab425ad7b77a None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:04.712513 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800ada8-7aab-48eb-88f4-ab425ad7b77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:04.730194 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52356f06-7c8b-4d53-8be1-73d8b765a9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:04.732009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52356f06-7c8b-4d53-8be1-73d8b765a9f8 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:04.744300 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-8800ada8-7aab-48eb-88f4-ab425ad7b77a None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:04.746055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:04.747234 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-8800ada8-7aab-48eb-88f4-ab425ad7b77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:04.902861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 71/148] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:04.919167 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 78/149] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:04.924872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800ada8-7aab-48eb-88f4-ab425ad7b77a None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:04.973575 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52356f06-7c8b-4d53-8be1-73d8b765a9f8 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:05.133621 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800ada8-7aab-48eb-88f4-ab425ad7b77a None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:05.152265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:05.170096 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52356f06-7c8b-4d53-8be1-73d8b765a9f8 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:05.180744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433a4a-eaaf-47e9-bbc5-d0e8bde28d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:05.182108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433a4a-eaaf-47e9-bbc5-d0e8bde28d09 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:05.182453 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433a4a-eaaf-47e9-bbc5-d0e8bde28d09 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:05.182749 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433a4a-eaaf-47e9-bbc5-d0e8bde28d09 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:05.185554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3433a4a-eaaf-47e9-bbc5-d0e8bde28d09 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:05.187081 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3433a4a-eaaf-47e9-bbc5-d0e8bde28d09 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:05.188425 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:05.189529 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 72/150] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:04 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:05.195868 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433a4a-eaaf-47e9-bbc5-d0e8bde28d09 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:05.230419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a184e4-bf0f-466c-84eb-476102e39749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:05.231239 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a184e4-bf0f-466c-84eb-476102e39749 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:05.231530 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a184e4-bf0f-466c-84eb-476102e39749 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:05.231811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a184e4-bf0f-466c-84eb-476102e39749 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:05.247704 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a184e4-bf0f-466c-84eb-476102e39749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-78a184e4-bf0f-466c-84eb-476102e39749 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:05.256766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:05.257880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:05.258741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 79/151] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:05.264280 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a184e4-bf0f-466c-84eb-476102e39749 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:05.375894 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433a4a-eaaf-47e9-bbc5-d0e8bde28d09 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:05.439005 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9167-110d-4b04-a919-add06be1cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:05.439600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9167-110d-4b04-a919-add06be1cd19 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:05.439878 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9167-110d-4b04-a919-add06be1cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:05.440160 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9167-110d-4b04-a919-add06be1cd19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:05.441006 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9167-110d-4b04-a919-add06be1cd19 None admin] RBAC: Adding query filter params (role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5, user.id=7840bfcb9b9443cc92e2e8f6e347f9b9) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:05.441326 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9167-110d-4b04-a919-add06be1cd19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:05.442834 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f9167-110d-4b04-a919-add06be1cd19 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:05.456055 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 73/152] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:05 2022] GET /identity/v3/role_assignments?user.id=7840bfcb9b9443cc92e2e8f6e347f9b9&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:05.459218 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a184e4-bf0f-466c-84eb-476102e39749 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:05.508296 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fda6cb-c90e-450b-b866-9cf52ba5c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:05.509558 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda6cb-c90e-450b-b866-9cf52ba5c6ba None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:05.509851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda6cb-c90e-450b-b866-9cf52ba5c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:05.510134 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda6cb-c90e-450b-b866-9cf52ba5c6ba None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:05.510933 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fda6cb-c90e-450b-b866-9cf52ba5c6ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:05.511245 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fda6cb-c90e-450b-b866-9cf52ba5c6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:05.512659 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fda6cb-c90e-450b-b866-9cf52ba5c6ba None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:05.526952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 80/153] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:05.532786 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9167-110d-4b04-a919-add06be1cd19 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:05.588152 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:05.656802 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9167-110d-4b04-a919-add06be1cd19 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:05.703244 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b3410-6137-4b49-8344-f49aced6ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:05.704078 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b3410-6137-4b49-8344-f49aced6ea4b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:05.704369 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b3410-6137-4b49-8344-f49aced6ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:05.704654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b3410-6137-4b49-8344-f49aced6ea4b None admin] PATH_INFO: `/v3/users/7d0ccd0896914ac48301b71e39cfa14c` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:05.706000 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b3410-6137-4b49-8344-f49aced6ea4b None admin] RBAC: Authorizing `identity:get_user(user_id=7d0ccd0896914ac48301b71e39cfa14c)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:05.707494 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b3410-6137-4b49-8344-f49aced6ea4b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:05.709179 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 74/154] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:05 2022] GET /identity/v3/users/7d0ccd0896914ac48301b71e39cfa14c => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:05.717001 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fda6cb-c90e-450b-b866-9cf52ba5c6ba None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:05.760553 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:05.842750 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fda6cb-c90e-450b-b866-9cf52ba5c6ba None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:05.882064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb4c29-ab4d-43ad-8107-aec5bcc3ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:05.883041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb4c29-ab4d-43ad-8107-aec5bcc3ad26 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:05.883332 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb4c29-ab4d-43ad-8107-aec5bcc3ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:05.883612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb4c29-ab4d-43ad-8107-aec5bcc3ad26 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:05.884963 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb4c29-ab4d-43ad-8107-aec5bcc3ad26 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:05.886477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb4c29-ab4d-43ad-8107-aec5bcc3ad26 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:05.888325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 81/155] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:05 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:05.894193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b3410-6137-4b49-8344-f49aced6ea4b None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:06.019832 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b3410-6137-4b49-8344-f49aced6ea4b None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:06.025970 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158a7ac-9081-49d5-bb68-80d491cdba20 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.026284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158a7ac-9081-49d5-bb68-80d491cdba20 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.026578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158a7ac-9081-49d5-bb68-80d491cdba20 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.028174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 82/156] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:06.034046 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28216-4834-4970-8ce6-dadf442fcf49 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.034416 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28216-4834-4970-8ce6-dadf442fcf49 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.034636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28216-4834-4970-8ce6-dadf442fcf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.047556 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:06.064540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-cab28216-4834-4970-8ce6-dadf442fcf49 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:06.065771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-cab28216-4834-4970-8ce6-dadf442fcf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:06.077829 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c37d3-b2a1-462b-82a1-2edac3b56b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:06.078802 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c37d3-b2a1-462b-82a1-2edac3b56b0c None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.079096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c37d3-b2a1-462b-82a1-2edac3b56b0c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.079382 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c37d3-b2a1-462b-82a1-2edac3b56b0c None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/users/7d0ccd0896914ac48301b71e39cfa14c/roles/c10458d8928f42bdb48358e0b4ca344e` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.092316 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c37d3-b2a1-462b-82a1-2edac3b56b0c None admin] RBAC: Authorizing `identity:create_grant(project_id=e9017adacd6f4b29adabe3bdb6713cc5, user_id=7d0ccd0896914ac48301b71e39cfa14c, role_id=c10458d8928f42bdb48358e0b4ca344e)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:06.093827 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c37d3-b2a1-462b-82a1-2edac3b56b0c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:06.158593 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 83/157] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:06.184842 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 75/158] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:56:05 2022] PUT /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/users/7d0ccd0896914ac48301b71e39cfa14c/roles/c10458d8928f42bdb48358e0b4ca344e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:06.187057 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab28216-4834-4970-8ce6-dadf442fcf49 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:06.219820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:06.301180 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab28216-4834-4970-8ce6-dadf442fcf49 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:06.341632 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ffda2-acdf-498a-80e3-59e946440476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:06.342476 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ffda2-acdf-498a-80e3-59e946440476 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.342770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ffda2-acdf-498a-80e3-59e946440476 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.343055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ffda2-acdf-498a-80e3-59e946440476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.354803 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ffda2-acdf-498a-80e3-59e946440476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-9c2ffda2-acdf-498a-80e3-59e946440476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:06.362735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:06.365256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:06.367279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 84/159] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:06.375532 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c37d3-b2a1-462b-82a1-2edac3b56b0c None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:06.498739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c37d3-b2a1-462b-82a1-2edac3b56b0c None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:06.544384 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8427d-d678-4090-a6c5-27b8860fb90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:06.545456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8427d-d678-4090-a6c5-27b8860fb90d None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.545930 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8427d-d678-4090-a6c5-27b8860fb90d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.546426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8427d-d678-4090-a6c5-27b8860fb90d None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.547448 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8427d-d678-4090-a6c5-27b8860fb90d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:06.547939 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8427d-d678-4090-a6c5-27b8860fb90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:06.549571 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8427d-d678-4090-a6c5-27b8860fb90d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:06.559341 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 76/160] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:06.565217 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ffda2-acdf-498a-80e3-59e946440476 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:06.664805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:06.677700 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ffda2-acdf-498a-80e3-59e946440476 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:06.715286 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792628f3-3d6c-455d-916f-9b86c025a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:06.716776 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792628f3-3d6c-455d-916f-9b86c025a368 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.717250 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792628f3-3d6c-455d-916f-9b86c025a368 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.717428 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a3512-da3c-4eef-99a6-d90a989ce8de None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.717711 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a3512-da3c-4eef-99a6-d90a989ce8de None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.718003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a3512-da3c-4eef-99a6-d90a989ce8de None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.718245 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792628f3-3d6c-455d-916f-9b86c025a368 None admin] PATH_INFO: `/v3/users/d63265941a9946a497001fc63bf2b23c` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.719740 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 77/161] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:06.720166 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792628f3-3d6c-455d-916f-9b86c025a368 None admin] RBAC: Authorizing `identity:get_user(user_id=d63265941a9946a497001fc63bf2b23c)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:06.721952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792628f3-3d6c-455d-916f-9b86c025a368 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:06.723890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 85/162] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:06 2022] GET /identity/v3/users/d63265941a9946a497001fc63bf2b23c => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:06.729877 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd388ba-5181-4a30-b3dd-b8419b588c5a None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.729877 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd388ba-5181-4a30-b3dd-b8419b588c5a None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.729877 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd388ba-5181-4a30-b3dd-b8419b588c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.730123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792628f3-3d6c-455d-916f-9b86c025a368 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:06.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-0cd388ba-5181-4a30-b3dd-b8419b588c5a None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:06.748447 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-0cd388ba-5181-4a30-b3dd-b8419b588c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:06.784062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:06.857282 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 78/163] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:06.873898 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792628f3-3d6c-455d-916f-9b86c025a368 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:06.883288 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3f33d-9b5d-4a16-b317-c6f9863265cb None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.883588 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3f33d-9b5d-4a16-b317-c6f9863265cb None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.884444 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3f33d-9b5d-4a16-b317-c6f9863265cb None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.885820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 79/164] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:06.890915 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ba1f-85c8-44f0-bf11-81874fb09595 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.891215 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ba1f-85c8-44f0-bf11-81874fb09595 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.891505 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ba1f-85c8-44f0-bf11-81874fb09595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.908552 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-cc63ba1f-85c8-44f0-bf11-81874fb09595 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:06.909959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-cc63ba1f-85c8-44f0-bf11-81874fb09595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:06.913349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d5bce-cb9a-4541-9c0a-cb1d7f5fafa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:06.913685 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d5bce-cb9a-4541-9c0a-cb1d7f5fafa5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:06.913977 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d5bce-cb9a-4541-9c0a-cb1d7f5fafa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:06.914261 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d5bce-cb9a-4541-9c0a-cb1d7f5fafa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:06.945955 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:06.993042 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d5bce-cb9a-4541-9c0a-cb1d7f5fafa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:06.995501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d5bce-cb9a-4541-9c0a-cb1d7f5fafa5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:07.083985 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 80/165] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:07.084862 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63ba1f-85c8-44f0-bf11-81874fb09595 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:07.102391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 86/166] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 06:56:07.117456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d5bce-cb9a-4541-9c0a-cb1d7f5fafa5 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:07.182693 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:07.228259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d5bce-cb9a-4541-9c0a-cb1d7f5fafa5 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:07.265568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09320e7-b078-490a-b299-2baa30c1a90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:07.266857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09320e7-b078-490a-b299-2baa30c1a90c None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:07.267322 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09320e7-b078-490a-b299-2baa30c1a90c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:07.267741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09320e7-b078-490a-b299-2baa30c1a90c None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:07.269086 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09320e7-b078-490a-b299-2baa30c1a90c None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:07.270699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09320e7-b078-490a-b299-2baa30c1a90c None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:07.272889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 87/167] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:07 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:07.273951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09320e7-b078-490a-b299-2baa30c1a90c None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:07.319899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:07.329049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63ba1f-85c8-44f0-bf11-81874fb09595 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:07.386843 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a6ceb-fc59-4282-91a9-d1c4a44991e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:07.387976 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a6ceb-fc59-4282-91a9-d1c4a44991e8 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:07.388449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a6ceb-fc59-4282-91a9-d1c4a44991e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:07.388911 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a6ceb-fc59-4282-91a9-d1c4a44991e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:07.401170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a6ceb-fc59-4282-91a9-d1c4a44991e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:07.411803 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09320e7-b078-490a-b299-2baa30c1a90c None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-fb3a6ceb-fc59-4282-91a9-d1c4a44991e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:07.416303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:07.417338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:07.418134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:07.425238 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 81/168] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:07.426298 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a6ceb-fc59-4282-91a9-d1c4a44991e8 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:07.455821 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:07.474294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb37ab-7133-49c2-8e2b-83e09e86c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:07.475206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb37ab-7133-49c2-8e2b-83e09e86c73d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:07.475489 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb37ab-7133-49c2-8e2b-83e09e86c73d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:07.475764 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb37ab-7133-49c2-8e2b-83e09e86c73d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:07.489626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb37ab-7133-49c2-8e2b-83e09e86c73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-78eb37ab-7133-49c2-8e2b-83e09e86c73d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:07.500055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:07.500952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:07.502087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:07.510073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 88/169] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:07.515714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb37ab-7133-49c2-8e2b-83e09e86c73d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:07.615542 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a6ceb-fc59-4282-91a9-d1c4a44991e8 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:07.679137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b058ab6-1298-4097-b444-46eaf13b89a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:07.679715 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b058ab6-1298-4097-b444-46eaf13b89a9 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:07.680002 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b058ab6-1298-4097-b444-46eaf13b89a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:07.680280 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b058ab6-1298-4097-b444-46eaf13b89a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:07.681186 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b058ab6-1298-4097-b444-46eaf13b89a9 None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5, user.id=d63265941a9946a497001fc63bf2b23c) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:07.681500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b058ab6-1298-4097-b444-46eaf13b89a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:07.682990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b058ab6-1298-4097-b444-46eaf13b89a9 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:07.696345 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 82/170] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:07 2022] GET /identity/v3/role_assignments?user.id=d63265941a9946a497001fc63bf2b23c&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:07.697147 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b058ab6-1298-4097-b444-46eaf13b89a9 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:07.700499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb37ab-7133-49c2-8e2b-83e09e86c73d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:07.741702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:07.767372 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e507e4-2002-4850-828d-d701670b2ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:07.768050 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e507e4-2002-4850-828d-d701670b2ecf None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:07.768335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e507e4-2002-4850-828d-d701670b2ecf None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:07.768615 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e507e4-2002-4850-828d-d701670b2ecf None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:07.769654 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e507e4-2002-4850-828d-d701670b2ecf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:07.769964 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e507e4-2002-4850-828d-d701670b2ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:07.771451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e507e4-2002-4850-828d-d701670b2ecf None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:07.781432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 89/171] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:07.791808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e507e4-2002-4850-828d-d701670b2ecf None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:07.874837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:07.956869 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b058ab6-1298-4097-b444-46eaf13b89a9 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:08.020115 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e507e4-2002-4850-828d-d701670b2ecf None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:08.021277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e479d9-ed4e-4ad1-b60b-46473032b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:08.022661 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e479d9-ed4e-4ad1-b60b-46473032b903 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:08.023176 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e479d9-ed4e-4ad1-b60b-46473032b903 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:08.023658 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e479d9-ed4e-4ad1-b60b-46473032b903 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:08.025592 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e479d9-ed4e-4ad1-b60b-46473032b903 None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:08.026151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e479d9-ed4e-4ad1-b60b-46473032b903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:08.027815 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e479d9-ed4e-4ad1-b60b-46473032b903 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:08.039461 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 83/172] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:08.046655 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e479d9-ed4e-4ad1-b60b-46473032b903 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:08.083611 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580f22-bbef-42b2-96f2-758c0c3dc714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:08.084494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580f22-bbef-42b2-96f2-758c0c3dc714 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:08.084775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580f22-bbef-42b2-96f2-758c0c3dc714 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:08.085048 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580f22-bbef-42b2-96f2-758c0c3dc714 None admin] PATH_INFO: `/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:08.086249 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580f22-bbef-42b2-96f2-758c0c3dc714 None admin] RBAC: Authorizing `identity:get_user(user_id=7840bfcb9b9443cc92e2e8f6e347f9b9)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:08.087948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580f22-bbef-42b2-96f2-758c0c3dc714 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:08.089561 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 90/173] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:07 2022] GET /identity/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:08.103285 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580f22-bbef-42b2-96f2-758c0c3dc714 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:08.246206 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:08.280970 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580f22-bbef-42b2-96f2-758c0c3dc714 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:08.283873 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e479d9-ed4e-4ad1-b60b-46473032b903 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:08.309277 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:08.341853 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c77c53-fa01-4e96-ae73-0bad863e4350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:08.342612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c77c53-fa01-4e96-ae73-0bad863e4350 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:08.342903 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c77c53-fa01-4e96-ae73-0bad863e4350 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:08.343184 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c77c53-fa01-4e96-ae73-0bad863e4350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:08.348846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c18e1a-4889-4f42-bbce-cd3802faff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:08.349727 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c18e1a-4889-4f42-bbce-cd3802faff92 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:08.350013 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c18e1a-4889-4f42-bbce-cd3802faff92 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:08.350291 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c18e1a-4889-4f42-bbce-cd3802faff92 None admin] PATH_INFO: `/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:08.356777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c18e1a-4889-4f42-bbce-cd3802faff92 None admin] RBAC: Authorizing `identity:get_user(user_id=7840bfcb9b9443cc92e2e8f6e347f9b9)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:08.358239 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c18e1a-4889-4f42-bbce-cd3802faff92 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:08.359946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 84/174] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:08 2022] GET /identity/v3/users/7840bfcb9b9443cc92e2e8f6e347f9b9 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:08.365844 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c18e1a-4889-4f42-bbce-cd3802faff92 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:08.472399 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c77c53-fa01-4e96-ae73-0bad863e4350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:08.473881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c77c53-fa01-4e96-ae73-0bad863e4350 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:08.556297 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c18e1a-4889-4f42-bbce-cd3802faff92 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:08.616345 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991cde9-8e3c-4521-885f-f172ec088386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:08.617022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991cde9-8e3c-4521-885f-f172ec088386 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:08.617280 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991cde9-8e3c-4521-885f-f172ec088386 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:08.617562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991cde9-8e3c-4521-885f-f172ec088386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:08.646444 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:08.664897 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 91/175] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:08.676675 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c77c53-fa01-4e96-ae73-0bad863e4350 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:08.722702 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:08.728281 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991cde9-8e3c-4521-885f-f172ec088386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:08.729964 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991cde9-8e3c-4521-885f-f172ec088386 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:08.853072 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 85/176] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 06:56:08.859266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991cde9-8e3c-4521-885f-f172ec088386 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:08.916606 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c77c53-fa01-4e96-ae73-0bad863e4350 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:08.932176 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:08.987191 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b047f04-87ba-4ae1-8ecf-717ddb5336f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:08.988315 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b047f04-87ba-4ae1-8ecf-717ddb5336f4 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:08.988780 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b047f04-87ba-4ae1-8ecf-717ddb5336f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:08.989213 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b047f04-87ba-4ae1-8ecf-717ddb5336f4 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:08.990607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b047f04-87ba-4ae1-8ecf-717ddb5336f4 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:08.992226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b047f04-87ba-4ae1-8ecf-717ddb5336f4 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:08.994189 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 92/177] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:08 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:09.003503 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b047f04-87ba-4ae1-8ecf-717ddb5336f4 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:09.070443 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991cde9-8e3c-4521-885f-f172ec088386 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:09.179291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:09.187054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb19ca-74c9-4762-be13-300d5d4170c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:09.187944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb19ca-74c9-4762-be13-300d5d4170c6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.188234 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb19ca-74c9-4762-be13-300d5d4170c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.188513 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb19ca-74c9-4762-be13-300d5d4170c6 None admin] PATH_INFO: `/v3/projects/8ccd732f0ae14646a9417241b049a995` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.189761 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb19ca-74c9-4762-be13-300d5d4170c6 None admin] RBAC: Authorizing `identity:get_project(project_id=8ccd732f0ae14646a9417241b049a995)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:09.191312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb19ca-74c9-4762-be13-300d5d4170c6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:09.199417 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 86/178] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:08 2022] GET /identity/v3/projects/8ccd732f0ae14646a9417241b049a995 => generated 312 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:09.199534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b047f04-87ba-4ae1-8ecf-717ddb5336f4 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:09.199613 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb19ca-74c9-4762-be13-300d5d4170c6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:09.258479 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2a100-b610-403d-9fc9-5ba527e6866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:09.259538 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2a100-b610-403d-9fc9-5ba527e6866f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.260246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2a100-b610-403d-9fc9-5ba527e6866f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.260721 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2a100-b610-403d-9fc9-5ba527e6866f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.261758 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2a100-b610-403d-9fc9-5ba527e6866f None admin] RBAC: Adding query filter params (role.id=33a7efc2edd44d81bc33bfd6d02c61cb, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5, user.id=7840bfcb9b9443cc92e2e8f6e347f9b9) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:09.262267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2a100-b610-403d-9fc9-5ba527e6866f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:09.264407 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2a100-b610-403d-9fc9-5ba527e6866f None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:09.278117 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 93/179] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:09 2022] GET /identity/v3/role_assignments?user.id=7840bfcb9b9443cc92e2e8f6e347f9b9&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=33a7efc2edd44d81bc33bfd6d02c61cb => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:09.342853 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ea3e2-1e95-4832-b2e2-9244a44e2359 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.343770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ea3e2-1e95-4832-b2e2-9244a44e2359 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.345030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ea3e2-1e95-4832-b2e2-9244a44e2359 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.347514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 94/180] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:09.354089 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847870bd-382d-4d11-8c40-f9287df5b3e2 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.355188 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847870bd-382d-4d11-8c40-f9287df5b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.355674 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847870bd-382d-4d11-8c40-f9287df5b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.387321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-847870bd-382d-4d11-8c40-f9287df5b3e2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:09.389668 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-847870bd-382d-4d11-8c40-f9287df5b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:09.430989 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb19ca-74c9-4762-be13-300d5d4170c6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:09.467372 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:09.512836 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89728465-c274-41f9-bb08-5b4ef0156d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:09.515469 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89728465-c274-41f9-bb08-5b4ef0156d22 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.516055 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89728465-c274-41f9-bb08-5b4ef0156d22 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.516592 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89728465-c274-41f9-bb08-5b4ef0156d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.517573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89728465-c274-41f9-bb08-5b4ef0156d22 None admin] RBAC: Adding query filter params (role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=8ccd732f0ae14646a9417241b049a995, user.id=7840bfcb9b9443cc92e2e8f6e347f9b9) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:09.517889 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89728465-c274-41f9-bb08-5b4ef0156d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:09.520034 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89728465-c274-41f9-bb08-5b4ef0156d22 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:09.528098 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 87/181] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:09 2022] GET /identity/v3/role_assignments?user.id=7840bfcb9b9443cc92e2e8f6e347f9b9&scope.project.id=8ccd732f0ae14646a9417241b049a995&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:09.529279 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31146253-1fe8-463e-9469-af5cdaa680b2 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.530366 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31146253-1fe8-463e-9469-af5cdaa680b2 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.530366 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31146253-1fe8-463e-9469-af5cdaa680b2 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.531284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 88/182] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:09.532248 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab70a4-103d-4acd-aacd-fff2cbef6308 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.532545 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab70a4-103d-4acd-aacd-fff2cbef6308 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.532828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab70a4-103d-4acd-aacd-fff2cbef6308 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.534275 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 89/183] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:09.543109 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 95/184] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:09.544438 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59c3a1-9445-4e44-a660-471385b0d8b9 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.544735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59c3a1-9445-4e44-a660-471385b0d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.547727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59c3a1-9445-4e44-a660-471385b0d8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.547837 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f68b40-2bb5-4737-96b0-7fb384ea8202 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.547915 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f68b40-2bb5-4737-96b0-7fb384ea8202 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.548182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f68b40-2bb5-4737-96b0-7fb384ea8202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.570225 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-0f59c3a1-9445-4e44-a660-471385b0d8b9 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:09.572432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-0f59c3a1-9445-4e44-a660-471385b0d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:09.588092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-e8f68b40-2bb5-4737-96b0-7fb384ea8202 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:09.589299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-e8f68b40-2bb5-4737-96b0-7fb384ea8202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:09.659165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 96/185] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:09.667779 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59c3a1-9445-4e44-a660-471385b0d8b9 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:09.676823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 90/186] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:09.694451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f68b40-2bb5-4737-96b0-7fb384ea8202 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:09.710364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:09.817743 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59c3a1-9445-4e44-a660-471385b0d8b9 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:09.830516 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f68b40-2bb5-4737-96b0-7fb384ea8202 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:09.847424 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:09.867270 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab60bf-cabf-48fd-9bf0-ba500e8a282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:09.868627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab60bf-cabf-48fd-9bf0-ba500e8a282b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.868986 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab60bf-cabf-48fd-9bf0-ba500e8a282b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.869251 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab60bf-cabf-48fd-9bf0-ba500e8a282b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.882646 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ebffa-8641-46fb-82e6-6f2b7e096d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:09.883535 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ebffa-8641-46fb-82e6-6f2b7e096d5f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:09.884461 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ebffa-8641-46fb-82e6-6f2b7e096d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:09.884805 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ebffa-8641-46fb-82e6-6f2b7e096d5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:09.886035 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab60bf-cabf-48fd-9bf0-ba500e8a282b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:09.886196 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ebffa-8641-46fb-82e6-6f2b7e096d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:09.887784 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ebffa-8641-46fb-82e6-6f2b7e096d5f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:09.889642 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 91/187] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:09.890445 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ebffa-8641-46fb-82e6-6f2b7e096d5f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-d1ab60bf-cabf-48fd-9bf0-ba500e8a282b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:09.898581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:09.899522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:09.900311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:09.904982 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 97/188] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:09.905865 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab60bf-cabf-48fd-9bf0-ba500e8a282b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:09.986247 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:10.005897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ebffa-8641-46fb-82e6-6f2b7e096d5f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:10.025713 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab60bf-cabf-48fd-9bf0-ba500e8a282b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:10.039605 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364e987-45f1-43da-aad4-35edea87d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:10.040454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e987-45f1-43da-aad4-35edea87d5d0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.040744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e987-45f1-43da-aad4-35edea87d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.041024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e987-45f1-43da-aad4-35edea87d5d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.051064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364e987-45f1-43da-aad4-35edea87d5d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-d364e987-45f1-43da-aad4-35edea87d5d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:10.059230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:10.060106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 92/189] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:56:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:10.061225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364e987-45f1-43da-aad4-35edea87d5d0 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:10.068100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019995-eba6-462c-9ea5-bf76c9f33335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:10.068783 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019995-eba6-462c-9ea5-bf76c9f33335 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.069080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019995-eba6-462c-9ea5-bf76c9f33335 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.069364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019995-eba6-462c-9ea5-bf76c9f33335 None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.070208 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019995-eba6-462c-9ea5-bf76c9f33335 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:10.072531 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019995-eba6-462c-9ea5-bf76c9f33335 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:10.096986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:10.149843 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 98/190] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:56:09 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:10.150995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019995-eba6-462c-9ea5-bf76c9f33335 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:10.180554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364e987-45f1-43da-aad4-35edea87d5d0 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:10.230746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b930bc1-d0c1-44ce-aa40-c71d284cd957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:10.231440 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b930bc1-d0c1-44ce-aa40-c71d284cd957 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.231726 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b930bc1-d0c1-44ce-aa40-c71d284cd957 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.232022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b930bc1-d0c1-44ce-aa40-c71d284cd957 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.232778 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b930bc1-d0c1-44ce-aa40-c71d284cd957 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:10.233090 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b930bc1-d0c1-44ce-aa40-c71d284cd957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:10.234550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b930bc1-d0c1-44ce-aa40-c71d284cd957 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:10.245009 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 93/191] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:10.249965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b930bc1-d0c1-44ce-aa40-c71d284cd957 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:10.288247 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019995-eba6-462c-9ea5-bf76c9f33335 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:10.314089 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:10.327696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41752ab8-7bf6-489f-9385-1753c21a0953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:10.333256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752ab8-7bf6-489f-9385-1753c21a0953 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.333256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752ab8-7bf6-489f-9385-1753c21a0953 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.333256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752ab8-7bf6-489f-9385-1753c21a0953 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.333256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41752ab8-7bf6-489f-9385-1753c21a0953 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:10.333256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41752ab8-7bf6-489f-9385-1753c21a0953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:10.333256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41752ab8-7bf6-489f-9385-1753c21a0953 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:10.342179 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 99/192] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:10.343717 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affdf8c-4411-4ada-8b54-3f0542fe39a1 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.344252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affdf8c-4411-4ada-8b54-3f0542fe39a1 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.344551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affdf8c-4411-4ada-8b54-3f0542fe39a1 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.346429 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 100/193] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:10.351203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affdf8c-4411-4ada-8b54-3f0542fe39a1 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:10.377160 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:10.382228 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b930bc1-d0c1-44ce-aa40-c71d284cd957 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:10.420723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfb8e6-17fe-4792-8dee-bdd9e1bd1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:10.421611 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfb8e6-17fe-4792-8dee-bdd9e1bd1dec None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.421902 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfb8e6-17fe-4792-8dee-bdd9e1bd1dec None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.422189 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfb8e6-17fe-4792-8dee-bdd9e1bd1dec None admin] PATH_INFO: `/v3/users/ea3c4331becf4f81814cd775b4bbe7fe` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.438690 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfb8e6-17fe-4792-8dee-bdd9e1bd1dec None admin] RBAC: Authorizing `identity:get_user(user_id=ea3c4331becf4f81814cd775b4bbe7fe)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:10.440158 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfb8e6-17fe-4792-8dee-bdd9e1bd1dec None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:10.441887 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 94/194] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:10 2022] GET /identity/v3/users/ea3c4331becf4f81814cd775b4bbe7fe => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:10.443130 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bee856-797f-4a34-ae42-ee4ef3054595 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.443425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bee856-797f-4a34-ae42-ee4ef3054595 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.443712 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bee856-797f-4a34-ae42-ee4ef3054595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.467421 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-f9bee856-797f-4a34-ae42-ee4ef3054595 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:10.467421 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-f9bee856-797f-4a34-ae42-ee4ef3054595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:10.479265 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affdf8c-4411-4ada-8b54-3f0542fe39a1 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:10.521669 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e9a97-5d7b-4b03-b2be-d73cdea48d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:10.522554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9a97-5d7b-4b03-b2be-d73cdea48d75 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.522842 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9a97-5d7b-4b03-b2be-d73cdea48d75 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.523120 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9a97-5d7b-4b03-b2be-d73cdea48d75 None admin] PATH_INFO: `/v3/users/ea3c4331becf4f81814cd775b4bbe7fe` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.525609 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e9a97-5d7b-4b03-b2be-d73cdea48d75 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3c4331becf4f81814cd775b4bbe7fe)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:10.526541 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e9a97-5d7b-4b03-b2be-d73cdea48d75 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:10.528253 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 101/195] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:10 2022] GET /identity/v3/users/ea3c4331becf4f81814cd775b4bbe7fe => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:10.528947 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e9a97-5d7b-4b03-b2be-d73cdea48d75 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:10.552586 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 95/196] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:10.553445 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bee856-797f-4a34-ae42-ee4ef3054595 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:10.597258 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:10.650782 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:10.659059 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e9a97-5d7b-4b03-b2be-d73cdea48d75 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:10.667720 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bee856-797f-4a34-ae42-ee4ef3054595 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:10.696169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804343-3780-4ec8-be9c-10df4664b3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:10.696857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804343-3780-4ec8-be9c-10df4664b3c1 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.697143 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804343-3780-4ec8-be9c-10df4664b3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.697658 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804343-3780-4ec8-be9c-10df4664b3c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.705704 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a259e8c-036c-4b3d-acdb-8beaec1fcee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:10.707055 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a259e8c-036c-4b3d-acdb-8beaec1fcee5 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:10.707567 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a259e8c-036c-4b3d-acdb-8beaec1fcee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:10.708284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a259e8c-036c-4b3d-acdb-8beaec1fcee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:10.768224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804343-3780-4ec8-be9c-10df4664b3c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:10.769711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804343-3780-4ec8-be9c-10df4664b3c1 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:10.784261 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a259e8c-036c-4b3d-acdb-8beaec1fcee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:10.786146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a259e8c-036c-4b3d-acdb-8beaec1fcee5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:10.823854 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:10.877732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 102/197] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:10.877732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804343-3780-4ec8-be9c-10df4664b3c1 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:10.902913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:10.903579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 96/198] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:10.904600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a259e8c-036c-4b3d-acdb-8beaec1fcee5 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:10.979647 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804343-3780-4ec8-be9c-10df4664b3c1 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:11.016029 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57337bb1-841b-4858-a643-3b63762ef2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:11.016836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57337bb1-841b-4858-a643-3b63762ef2ab None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:11.017118 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57337bb1-841b-4858-a643-3b63762ef2ab None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:11.017401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57337bb1-841b-4858-a643-3b63762ef2ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:11.025305 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a259e8c-036c-4b3d-acdb-8beaec1fcee5 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:11.028310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57337bb1-841b-4858-a643-3b63762ef2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-57337bb1-841b-4858-a643-3b63762ef2ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:11.035791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:11.036642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:11.037422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 103/199] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:11.038071 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57337bb1-841b-4858-a643-3b63762ef2ab None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:11.054968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:11.067781 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b4b10-cc42-490b-a6fe-f4e6e9ab0e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:11.068869 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4b10-cc42-490b-a6fe-f4e6e9ab0e56 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:11.069300 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4b10-cc42-490b-a6fe-f4e6e9ab0e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:11.069717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4b10-cc42-490b-a6fe-f4e6e9ab0e56 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:11.071129 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4b10-cc42-490b-a6fe-f4e6e9ab0e56 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:11.080840 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4b10-cc42-490b-a6fe-f4e6e9ab0e56 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:11.080840 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 97/200] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:10 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:11.080840 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b4b10-cc42-490b-a6fe-f4e6e9ab0e56 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:11.141933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:11.153339 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57337bb1-841b-4858-a643-3b63762ef2ab None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:11.191262 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5164f27-e032-49ba-9dd4-2b1acd0ffae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:11.191507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b4b10-cc42-490b-a6fe-f4e6e9ab0e56 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:11.192132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164f27-e032-49ba-9dd4-2b1acd0ffae0 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:11.192423 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164f27-e032-49ba-9dd4-2b1acd0ffae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:11.192702 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164f27-e032-49ba-9dd4-2b1acd0ffae0 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:11.194049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5164f27-e032-49ba-9dd4-2b1acd0ffae0 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:11.195625 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5164f27-e032-49ba-9dd4-2b1acd0ffae0 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:11.197948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 104/201] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:11 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:11.202611 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5164f27-e032-49ba-9dd4-2b1acd0ffae0 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:11.235756 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a075b6-d4a7-4684-a397-48222befad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:11.236696 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a075b6-d4a7-4684-a397-48222befad4b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:11.237125 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a075b6-d4a7-4684-a397-48222befad4b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:11.237545 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a075b6-d4a7-4684-a397-48222befad4b None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:11.238471 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a075b6-d4a7-4684-a397-48222befad4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:11.238985 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a075b6-d4a7-4684-a397-48222befad4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:11.240606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a075b6-d4a7-4684-a397-48222befad4b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:11.250069 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 98/202] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:11.251407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a075b6-d4a7-4684-a397-48222befad4b None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:11.291502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:11.312032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5164f27-e032-49ba-9dd4-2b1acd0ffae0 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:11.348378 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e40761-344d-4d27-9d78-97b61d5ef225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:11.349046 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e40761-344d-4d27-9d78-97b61d5ef225 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:11.349336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e40761-344d-4d27-9d78-97b61d5ef225 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:11.349838 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e40761-344d-4d27-9d78-97b61d5ef225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:11.350683 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e40761-344d-4d27-9d78-97b61d5ef225 None admin] RBAC: Adding query filter params (role.id=33a7efc2edd44d81bc33bfd6d02c61cb, scope.project.id=d5ac856d373a44118058b6acc934e6e4, user.id=ea3c4331becf4f81814cd775b4bbe7fe) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:11.351217 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e40761-344d-4d27-9d78-97b61d5ef225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:11.353154 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e40761-344d-4d27-9d78-97b61d5ef225 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:11.366364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 105/203] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:11 2022] GET /identity/v3/role_assignments?user.id=ea3c4331becf4f81814cd775b4bbe7fe&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=33a7efc2edd44d81bc33bfd6d02c61cb => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:11.366364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e40761-344d-4d27-9d78-97b61d5ef225 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:11.367842 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a075b6-d4a7-4684-a397-48222befad4b None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:11.413744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:11.455212 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a9e8-c71a-4eb6-8528-1e5ce31f1eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:11.455905 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a9e8-c71a-4eb6-8528-1e5ce31f1eff None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:11.456195 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a9e8-c71a-4eb6-8528-1e5ce31f1eff None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:11.456481 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a9e8-c71a-4eb6-8528-1e5ce31f1eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:11.457361 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a9e8-c71a-4eb6-8528-1e5ce31f1eff None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=d5ac856d373a44118058b6acc934e6e4, user.id=ea3c4331becf4f81814cd775b4bbe7fe) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:11.457685 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a9e8-c71a-4eb6-8528-1e5ce31f1eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:11.459302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a9e8-c71a-4eb6-8528-1e5ce31f1eff None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:11.478109 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 99/204] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:11 2022] GET /identity/v3/role_assignments?user.id=ea3c4331becf4f81814cd775b4bbe7fe&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:11.588842 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e40761-344d-4d27-9d78-97b61d5ef225 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:11.645595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b228136-cb50-497c-8beb-3a7db06babdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:11.646955 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b228136-cb50-497c-8beb-3a7db06babdf None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:11.647470 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b228136-cb50-497c-8beb-3a7db06babdf None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:11.647957 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b228136-cb50-497c-8beb-3a7db06babdf None admin] PATH_INFO: `/v3/users/7d0ccd0896914ac48301b71e39cfa14c` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:11.650049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b228136-cb50-497c-8beb-3a7db06babdf None admin] RBAC: Authorizing `identity:get_user(user_id=7d0ccd0896914ac48301b71e39cfa14c)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:11.651900 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b228136-cb50-497c-8beb-3a7db06babdf None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:11.653982 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 106/205] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:11 2022] GET /identity/v3/users/7d0ccd0896914ac48301b71e39cfa14c => generated 289 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:11.662384 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a9e8-c71a-4eb6-8528-1e5ce31f1eff None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:11.808401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a9e8-c71a-4eb6-8528-1e5ce31f1eff None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:11.846085 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd449f-9e4d-43f6-b5aa-bbccf32d3dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:11.847196 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd449f-9e4d-43f6-b5aa-bbccf32d3dd0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:11.847710 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd449f-9e4d-43f6-b5aa-bbccf32d3dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:11.848196 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd449f-9e4d-43f6-b5aa-bbccf32d3dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:11.939658 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd449f-9e4d-43f6-b5aa-bbccf32d3dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:11.941441 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd449f-9e4d-43f6-b5aa-bbccf32d3dd0 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:11.946133 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:12.107758 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 100/206] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:12.113361 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b228136-cb50-497c-8beb-3a7db06babdf None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:12.138941 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:12.245861 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b228136-cb50-497c-8beb-3a7db06babdf None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:12.285744 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a0f0e-d17c-45b4-894d-2634d8552b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:12.286659 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a0f0e-d17c-45b4-894d-2634d8552b5a None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:12.286945 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a0f0e-d17c-45b4-894d-2634d8552b5a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:12.287225 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a0f0e-d17c-45b4-894d-2634d8552b5a None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:12.288433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a0f0e-d17c-45b4-894d-2634d8552b5a None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:12.289901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a0f0e-d17c-45b4-894d-2634d8552b5a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:12.291994 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 107/207] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:12 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:12.297765 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd449f-9e4d-43f6-b5aa-bbccf32d3dd0 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:12.429346 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:12.449921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd449f-9e4d-43f6-b5aa-bbccf32d3dd0 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:12.498215 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0006ebd-b9cf-4de3-8b75-98141bb182a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:12.498905 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0006ebd-b9cf-4de3-8b75-98141bb182a1 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:12.499193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0006ebd-b9cf-4de3-8b75-98141bb182a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:12.499472 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0006ebd-b9cf-4de3-8b75-98141bb182a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:12.500308 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0006ebd-b9cf-4de3-8b75-98141bb182a1 None admin] RBAC: Adding query filter params (role.id=c10458d8928f42bdb48358e0b4ca344e, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5, user.id=7d0ccd0896914ac48301b71e39cfa14c) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:12.500622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0006ebd-b9cf-4de3-8b75-98141bb182a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:12.502581 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0006ebd-b9cf-4de3-8b75-98141bb182a1 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:12.514884 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 101/208] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:12 2022] GET /identity/v3/role_assignments?user.id=7d0ccd0896914ac48301b71e39cfa14c&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=c10458d8928f42bdb48358e0b4ca344e => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:12.872174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d522a-5171-4fcd-918c-e673703e76ac None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:12.872536 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d522a-5171-4fcd-918c-e673703e76ac None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:12.872757 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d522a-5171-4fcd-918c-e673703e76ac None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:12.874146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 108/209] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:12.884459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fc52f-72e2-4731-902f-082ee1a5d7d4 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:12.884927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fc52f-72e2-4731-902f-082ee1a5d7d4 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:12.885103 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fc52f-72e2-4731-902f-082ee1a5d7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:12.903480 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-804fc52f-72e2-4731-902f-082ee1a5d7d4 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:12.904707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-804fc52f-72e2-4731-902f-082ee1a5d7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:12.985879 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4ba41-80bc-4ed3-b30d-55d4ce2b46c8 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:12.986170 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4ba41-80bc-4ed3-b30d-55d4ce2b46c8 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:12.986488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4ba41-80bc-4ed3-b30d-55d4ce2b46c8 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:12.987864 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 109/210] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:12.995483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e7e5-5941-4e10-8131-2f5c420519e1 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:12.995483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e7e5-5941-4e10-8131-2f5c420519e1 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:12.995483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e7e5-5941-4e10-8131-2f5c420519e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:12.998523 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 102/211] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:13.013039 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-f5a9e7e5-5941-4e10-8131-2f5c420519e1 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:13.014396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-f5a9e7e5-5941-4e10-8131-2f5c420519e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:13.025118 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fc52f-72e2-4731-902f-082ee1a5d7d4 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:13.110423 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 110/212] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:13.134582 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:13.140799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e7e5-5941-4e10-8131-2f5c420519e1 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:13.166986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fc52f-72e2-4731-902f-082ee1a5d7d4 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:13.170765 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:13.204706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03e137-d0da-4bb0-beb7-07c0e1fc9169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:13.205860 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03e137-d0da-4bb0-beb7-07c0e1fc9169 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:13.206361 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03e137-d0da-4bb0-beb7-07c0e1fc9169 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:13.206863 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03e137-d0da-4bb0-beb7-07c0e1fc9169 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:13.217744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03e137-d0da-4bb0-beb7-07c0e1fc9169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-aa03e137-d0da-4bb0-beb7-07c0e1fc9169 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:13.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:13.226616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:13.227407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:13.229791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 103/213] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:13.236022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03e137-d0da-4bb0-beb7-07c0e1fc9169 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:13.266826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e7e5-5941-4e10-8131-2f5c420519e1 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:13.309951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6647b1-7338-4795-b6e1-bb14057cd4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:13.311265 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6647b1-7338-4795-b6e1-bb14057cd4ef None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:13.312482 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6647b1-7338-4795-b6e1-bb14057cd4ef None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:13.312992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6647b1-7338-4795-b6e1-bb14057cd4ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:13.314521 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6647b1-7338-4795-b6e1-bb14057cd4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:13.316162 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6647b1-7338-4795-b6e1-bb14057cd4ef None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:13.318414 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 111/214] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:13.324072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6647b1-7338-4795-b6e1-bb14057cd4ef None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:13.351819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03e137-d0da-4bb0-beb7-07c0e1fc9169 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:13.392434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235000d-88c4-4bb2-9fc3-02dbb67e0630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:13.393354 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235000d-88c4-4bb2-9fc3-02dbb67e0630 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:13.393816 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235000d-88c4-4bb2-9fc3-02dbb67e0630 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:13.394463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235000d-88c4-4bb2-9fc3-02dbb67e0630 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:13.395456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235000d-88c4-4bb2-9fc3-02dbb67e0630 None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:13.395991 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235000d-88c4-4bb2-9fc3-02dbb67e0630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:13.397554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235000d-88c4-4bb2-9fc3-02dbb67e0630 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:13.399124 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:13.407397 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 104/215] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:13.414886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235000d-88c4-4bb2-9fc3-02dbb67e0630 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:13.417603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:13.441044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6647b1-7338-4795-b6e1-bb14057cd4ef None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:13.476159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c17ff1-7700-4b11-b42d-9b3d9acacd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:13.477242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c17ff1-7700-4b11-b42d-9b3d9acacd71 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:13.478285 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c17ff1-7700-4b11-b42d-9b3d9acacd71 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:13.478813 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c17ff1-7700-4b11-b42d-9b3d9acacd71 None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:13.480973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c17ff1-7700-4b11-b42d-9b3d9acacd71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:13.482849 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c17ff1-7700-4b11-b42d-9b3d9acacd71 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:13.535494 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235000d-88c4-4bb2-9fc3-02dbb67e0630 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:13.572419 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a0c3c-a8c1-46ba-8e3a-c60158e463f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:13.573378 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a0c3c-a8c1-46ba-8e3a-c60158e463f7 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:13.573676 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a0c3c-a8c1-46ba-8e3a-c60158e463f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:13.573956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a0c3c-a8c1-46ba-8e3a-c60158e463f7 None admin] PATH_INFO: `/v3/users/6648d442daf24a4bb97bc39b10361655` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:13.581008 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 112/216] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:56:13 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:56:13.593557 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a0c3c-a8c1-46ba-8e3a-c60158e463f7 None admin] RBAC: Authorizing `identity:get_user(user_id=6648d442daf24a4bb97bc39b10361655)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:13.595316 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a0c3c-a8c1-46ba-8e3a-c60158e463f7 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:13.597561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 105/217] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:13 2022] GET /identity/v3/users/6648d442daf24a4bb97bc39b10361655 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:13.603718 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c17ff1-7700-4b11-b42d-9b3d9acacd71 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:13.722733 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c17ff1-7700-4b11-b42d-9b3d9acacd71 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:13.760030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7562ea6-9446-4ca4-aedb-a22a1633cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:13.760758 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7562ea6-9446-4ca4-aedb-a22a1633cc9a None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:13.761041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7562ea6-9446-4ca4-aedb-a22a1633cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:13.761319 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7562ea6-9446-4ca4-aedb-a22a1633cc9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:13.764442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:13.862262 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7562ea6-9446-4ca4-aedb-a22a1633cc9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:13.862879 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7562ea6-9446-4ca4-aedb-a22a1633cc9a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:13.985152 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 113/218] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 06 06:56:13.991635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a0c3c-a8c1-46ba-8e3a-c60158e463f7 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:14.058105 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:14.111682 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a0c3c-a8c1-46ba-8e3a-c60158e463f7 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:14.156725 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec32fd9-a7ab-4169-a979-c685adc58fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:14.157975 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec32fd9-a7ab-4169-a979-c685adc58fbf None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:14.158503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec32fd9-a7ab-4169-a979-c685adc58fbf None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:14.158989 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec32fd9-a7ab-4169-a979-c685adc58fbf None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:14.160553 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec32fd9-a7ab-4169-a979-c685adc58fbf None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:14.162227 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec32fd9-a7ab-4169-a979-c685adc58fbf None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:14.164189 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 106/219] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:13 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:14.170436 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7562ea6-9446-4ca4-aedb-a22a1633cc9a None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:14.207468 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:14.216708 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd055b66-0694-47fa-b657-a6c70a917966 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:14.217300 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd055b66-0694-47fa-b657-a6c70a917966 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:14.223503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd055b66-0694-47fa-b657-a6c70a917966 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:14.223503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 107/220] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:14.225769 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed25fa5-2c14-406f-a9f2-097a3f5041a6 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:14.226279 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed25fa5-2c14-406f-a9f2-097a3f5041a6 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:14.226801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed25fa5-2c14-406f-a9f2-097a3f5041a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:14.248152 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-7ed25fa5-2c14-406f-a9f2-097a3f5041a6 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:14.250212 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-7ed25fa5-2c14-406f-a9f2-097a3f5041a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:14.295083 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7562ea6-9446-4ca4-aedb-a22a1633cc9a None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:14.332333 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd19a94-3c72-4489-b4e3-2d70a89a65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:14.332775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19a94-3c72-4489-b4e3-2d70a89a65ee None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:14.333059 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19a94-3c72-4489-b4e3-2d70a89a65ee None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:14.333338 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19a94-3c72-4489-b4e3-2d70a89a65ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:14.334230 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd19a94-3c72-4489-b4e3-2d70a89a65ee None admin] RBAC: Adding query filter params (role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=d5ac856d373a44118058b6acc934e6e4, user.id=6648d442daf24a4bb97bc39b10361655) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:14.334514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd19a94-3c72-4489-b4e3-2d70a89a65ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:14.335957 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd19a94-3c72-4489-b4e3-2d70a89a65ee None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:14.342777 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 114/221] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:14 2022] GET /identity/v3/role_assignments?user.id=6648d442daf24a4bb97bc39b10361655&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:14.343836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70431-24aa-4c24-9b38-f40fe7b17309 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:14.344123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70431-24aa-4c24-9b38-f40fe7b17309 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:14.344408 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70431-24aa-4c24-9b38-f40fe7b17309 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:14.345697 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 115/222] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:14.350245 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 108/223] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:14.351224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aac44-298e-4381-bb96-d653367138d9 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:14.351511 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aac44-298e-4381-bb96-d653367138d9 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:14.351788 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aac44-298e-4381-bb96-d653367138d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:14.371018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-c62aac44-298e-4381-bb96-d653367138d9 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:14.372344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-c62aac44-298e-4381-bb96-d653367138d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:14.410034 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed25fa5-2c14-406f-a9f2-097a3f5041a6 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:14.463428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 116/224] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:14.499715 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aac44-298e-4381-bb96-d653367138d9 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:14.521292 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:14.558645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:14.593642 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed25fa5-2c14-406f-a9f2-097a3f5041a6 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:14.637675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8e7e3-d746-4dda-a362-1fe62430165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:14.638930 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8e7e3-d746-4dda-a362-1fe62430165b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:14.640186 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8e7e3-d746-4dda-a362-1fe62430165b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:14.640871 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8e7e3-d746-4dda-a362-1fe62430165b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:14.664242 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8e7e3-d746-4dda-a362-1fe62430165b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-27a8e7e3-d746-4dda-a362-1fe62430165b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:14.674744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:14.675675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:14.676477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:14.678941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 109/225] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:14.687644 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8e7e3-d746-4dda-a362-1fe62430165b None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:14.744889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aac44-298e-4381-bb96-d653367138d9 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:14.810304 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f90784-3234-4e3e-ad27-938e63cba573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:14.811205 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f90784-3234-4e3e-ad27-938e63cba573 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:14.811495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f90784-3234-4e3e-ad27-938e63cba573 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:14.811777 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f90784-3234-4e3e-ad27-938e63cba573 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:14.823219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f90784-3234-4e3e-ad27-938e63cba573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-c1f90784-3234-4e3e-ad27-938e63cba573 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:14.830889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:14.831768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:14.832568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 117/226] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:56:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:14.843413 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f90784-3234-4e3e-ad27-938e63cba573 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:14.843585 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8e7e3-d746-4dda-a362-1fe62430165b None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:14.858075 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:14.887191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ed197-de62-4b87-9432-6892266a6e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:14.887863 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ed197-de62-4b87-9432-6892266a6e80 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:14.888149 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ed197-de62-4b87-9432-6892266a6e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:14.888426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ed197-de62-4b87-9432-6892266a6e80 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:14.889185 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ed197-de62-4b87-9432-6892266a6e80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:14.889932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ed197-de62-4b87-9432-6892266a6e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:14.892156 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ed197-de62-4b87-9432-6892266a6e80 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:14.907395 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 110/227] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:14.919623 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ed197-de62-4b87-9432-6892266a6e80 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:14.986857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:14.996915 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f90784-3234-4e3e-ad27-938e63cba573 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:15.035785 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d07e1-22bb-4ff3-820c-56e227b416fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:15.036678 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d07e1-22bb-4ff3-820c-56e227b416fd None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:15.037063 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d07e1-22bb-4ff3-820c-56e227b416fd None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:15.037439 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d07e1-22bb-4ff3-820c-56e227b416fd None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:15.038589 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d07e1-22bb-4ff3-820c-56e227b416fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:15.039001 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d07e1-22bb-4ff3-820c-56e227b416fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:15.041043 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d07e1-22bb-4ff3-820c-56e227b416fd None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:15.055121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 118/228] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:15.056757 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d07e1-22bb-4ff3-820c-56e227b416fd None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:15.178815 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ed197-de62-4b87-9432-6892266a6e80 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:15.211401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d07e1-22bb-4ff3-820c-56e227b416fd None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:15.244801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ba7c-eade-4f85-8f86-2fbc97646089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:15.245678 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ba7c-eade-4f85-8f86-2fbc97646089 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:15.245965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ba7c-eade-4f85-8f86-2fbc97646089 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:15.246241 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ba7c-eade-4f85-8f86-2fbc97646089 None admin] PATH_INFO: `/v3/users/ea3c4331becf4f81814cd775b4bbe7fe` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:15.247556 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085ba7c-eade-4f85-8f86-2fbc97646089 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3c4331becf4f81814cd775b4bbe7fe)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:15.249059 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085ba7c-eade-4f85-8f86-2fbc97646089 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:15.251073 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 111/229] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:14 2022] GET /identity/v3/users/ea3c4331becf4f81814cd775b4bbe7fe => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:15.257414 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ba7c-eade-4f85-8f86-2fbc97646089 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:15.296522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3b76c-38bd-40d4-9702-cfa65ff69a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:15.297403 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3b76c-38bd-40d4-9702-cfa65ff69a24 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:15.297686 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3b76c-38bd-40d4-9702-cfa65ff69a24 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:15.297962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3b76c-38bd-40d4-9702-cfa65ff69a24 None admin] PATH_INFO: `/v3/users/ea3c4331becf4f81814cd775b4bbe7fe` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:15.301093 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3b76c-38bd-40d4-9702-cfa65ff69a24 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3c4331becf4f81814cd775b4bbe7fe)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:15.303465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3b76c-38bd-40d4-9702-cfa65ff69a24 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:15.308000 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 119/230] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:15 2022] GET /identity/v3/users/ea3c4331becf4f81814cd775b4bbe7fe => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:15.323748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3b76c-38bd-40d4-9702-cfa65ff69a24 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:15.338214 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:15.345862 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:15.449635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ba7c-eade-4f85-8f86-2fbc97646089 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:15.489546 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d71e-f700-41be-92cc-f41a2134fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:15.490446 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d71e-f700-41be-92cc-f41a2134fb76 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:15.490730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d71e-f700-41be-92cc-f41a2134fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:15.491007 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d71e-f700-41be-92cc-f41a2134fb76 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:15.494955 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545d71e-f700-41be-92cc-f41a2134fb76 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:15.499354 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545d71e-f700-41be-92cc-f41a2134fb76 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:15.502966 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 112/231] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:15 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:15.508607 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d71e-f700-41be-92cc-f41a2134fb76 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:15.525043 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3b76c-38bd-40d4-9702-cfa65ff69a24 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:15.590914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a9adc-c422-4646-bf01-7afb30ae0461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:15.591787 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a9adc-c422-4646-bf01-7afb30ae0461 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:15.592069 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a9adc-c422-4646-bf01-7afb30ae0461 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:15.592338 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a9adc-c422-4646-bf01-7afb30ae0461 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:15.593861 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a9adc-c422-4646-bf01-7afb30ae0461 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:15.595847 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a9adc-c422-4646-bf01-7afb30ae0461 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:15.598030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 120/232] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:15 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:15.603827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a9adc-c422-4646-bf01-7afb30ae0461 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:15.720247 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d71e-f700-41be-92cc-f41a2134fb76 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:15.744720 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:15.757843 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:15.786586 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a9adc-c422-4646-bf01-7afb30ae0461 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:15.798012 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db81846-b7b3-456a-98e6-9290447e265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:15.799210 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db81846-b7b3-456a-98e6-9290447e265d None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:15.799696 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db81846-b7b3-456a-98e6-9290447e265d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:15.800141 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db81846-b7b3-456a-98e6-9290447e265d None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4/users/ea3c4331becf4f81814cd775b4bbe7fe/roles/33a7efc2edd44d81bc33bfd6d02c61cb` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:15.803297 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db81846-b7b3-456a-98e6-9290447e265d None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ac856d373a44118058b6acc934e6e4, user_id=ea3c4331becf4f81814cd775b4bbe7fe, role_id=33a7efc2edd44d81bc33bfd6d02c61cb)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:15.804952 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db81846-b7b3-456a-98e6-9290447e265d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:15.839366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d5cf-0283-4465-8421-6dee84a16007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:15.840665 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d5cf-0283-4465-8421-6dee84a16007 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:15.841135 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d5cf-0283-4465-8421-6dee84a16007 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:15.841603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d5cf-0283-4465-8421-6dee84a16007 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4/users/ea3c4331becf4f81814cd775b4bbe7fe/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:15.843909 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d5cf-0283-4465-8421-6dee84a16007 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ac856d373a44118058b6acc934e6e4, user_id=ea3c4331becf4f81814cd775b4bbe7fe, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:15.845693 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d5cf-0283-4465-8421-6dee84a16007 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:15.877925 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 113/233] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:56:15 2022] PUT /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4/users/ea3c4331becf4f81814cd775b4bbe7fe/roles/33a7efc2edd44d81bc33bfd6d02c61cb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 06:56:15.944803 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 121/234] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:56:15 2022] PUT /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4/users/ea3c4331becf4f81814cd775b4bbe7fe/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 06:56:16.324379 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ff5d-c79b-4ae9-ad35-33b031a364ce None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:16.324896 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ff5d-c79b-4ae9-ad35-33b031a364ce None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:16.324998 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ff5d-c79b-4ae9-ad35-33b031a364ce None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:16.326493 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 114/235] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:16.331947 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4f931-9fa6-4386-ad3c-21095c474954 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:16.332352 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4f931-9fa6-4386-ad3c-21095c474954 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:16.332539 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4f931-9fa6-4386-ad3c-21095c474954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:16.351845 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-b1a4f931-9fa6-4386-ad3c-21095c474954 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:16.353578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-b1a4f931-9fa6-4386-ad3c-21095c474954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:16.446015 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 122/236] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:16.478658 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183ff5d-c79b-4ae9-ad35-33b031a364ce None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:16.589399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183ff5d-c79b-4ae9-ad35-33b031a364ce None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:16.626565 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c0ac2-ea39-44c5-9af1-4637bd800856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:16.627396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c0ac2-ea39-44c5-9af1-4637bd800856 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:16.627689 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c0ac2-ea39-44c5-9af1-4637bd800856 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:16.627974 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c0ac2-ea39-44c5-9af1-4637bd800856 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:16.638985 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c0ac2-ea39-44c5-9af1-4637bd800856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-a54c0ac2-ea39-44c5-9af1-4637bd800856 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:16.647003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:16.647886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:16.648675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 115/237] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:16.656051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4f931-9fa6-4386-ad3c-21095c474954 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:16.755232 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16a070-5af4-42a3-9749-287a8f69efc6 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:16.755572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16a070-5af4-42a3-9749-287a8f69efc6 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:16.755796 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16a070-5af4-42a3-9749-287a8f69efc6 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:16.757315 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 116/238] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:16.762633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763e04a-8ee5-4414-9cd9-b7ea651f005e None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:16.763201 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763e04a-8ee5-4414-9cd9-b7ea651f005e None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:16.763737 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763e04a-8ee5-4414-9cd9-b7ea651f005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:16.764387 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:16.792636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-e763e04a-8ee5-4414-9cd9-b7ea651f005e None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:16.795493 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-e763e04a-8ee5-4414-9cd9-b7ea651f005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:16.818984 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4f931-9fa6-4386-ad3c-21095c474954 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:16.842777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:16.896971 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8c161-3e81-4e4d-b47f-3057a4940635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:16.897665 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8c161-3e81-4e4d-b47f-3057a4940635 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:16.897955 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8c161-3e81-4e4d-b47f-3057a4940635 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:16.898239 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8c161-3e81-4e4d-b47f-3057a4940635 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:16.899053 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8c161-3e81-4e4d-b47f-3057a4940635 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:16.899943 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8c161-3e81-4e4d-b47f-3057a4940635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:16.901347 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8c161-3e81-4e4d-b47f-3057a4940635 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:16.924324 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 123/239] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:16.932163 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8c161-3e81-4e4d-b47f-3057a4940635 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:16.935332 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 117/240] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 06 06:56:16.979987 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763e04a-8ee5-4414-9cd9-b7ea651f005e None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:17.049566 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8c161-3e81-4e4d-b47f-3057a4940635 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:17.098624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe99cf0-c74b-41af-96d0-4463990d783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:17.099416 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99cf0-c74b-41af-96d0-4463990d783c None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:17.099698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99cf0-c74b-41af-96d0-4463990d783c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:17.099975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99cf0-c74b-41af-96d0-4463990d783c None admin] PATH_INFO: `/v3/users/55fc4dfc1a1a438faf88edec7acac37f` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:17.116868 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:17.129126 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe99cf0-c74b-41af-96d0-4463990d783c None admin] RBAC: Authorizing `identity:get_user(user_id=55fc4dfc1a1a438faf88edec7acac37f)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:17.130648 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe99cf0-c74b-41af-96d0-4463990d783c None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:17.132382 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 124/241] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:16 2022] GET /identity/v3/users/55fc4dfc1a1a438faf88edec7acac37f => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:17.139708 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe99cf0-c74b-41af-96d0-4463990d783c None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:17.140332 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763e04a-8ee5-4414-9cd9-b7ea651f005e None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:17.200979 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd91a95-50df-4d16-ae4d-18a8c17fee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:17.201789 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd91a95-50df-4d16-ae4d-18a8c17fee02 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:17.202074 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd91a95-50df-4d16-ae4d-18a8c17fee02 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:17.202368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd91a95-50df-4d16-ae4d-18a8c17fee02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:17.207724 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd91a95-50df-4d16-ae4d-18a8c17fee02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:17.209198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd91a95-50df-4d16-ae4d-18a8c17fee02 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:17.211106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 118/242] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:17.218971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd91a95-50df-4d16-ae4d-18a8c17fee02 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:17.253164 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:17.336159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe99cf0-c74b-41af-96d0-4463990d783c None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:17.348191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd91a95-50df-4d16-ae4d-18a8c17fee02 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:17.381370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a81ef-2c6a-4a6d-bb80-0f23db39a204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:17.381946 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a81ef-2c6a-4a6d-bb80-0f23db39a204 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:17.382230 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a81ef-2c6a-4a6d-bb80-0f23db39a204 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:17.382536 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a81ef-2c6a-4a6d-bb80-0f23db39a204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:17.388478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d49f82-4bf2-44aa-bc8f-dbca0bfe4d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:17.389410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d49f82-4bf2-44aa-bc8f-dbca0bfe4d31 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:17.391200 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d49f82-4bf2-44aa-bc8f-dbca0bfe4d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:17.391779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d49f82-4bf2-44aa-bc8f-dbca0bfe4d31 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:17.392703 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d49f82-4bf2-44aa-bc8f-dbca0bfe4d31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:17.394374 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d49f82-4bf2-44aa-bc8f-dbca0bfe4d31 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:17.451514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:17.458813 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a81ef-2c6a-4a6d-bb80-0f23db39a204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:17.467060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a81ef-2c6a-4a6d-bb80-0f23db39a204 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:17.467759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 119/243] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:56:17 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:17.469632 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32bcb1-b928-4772-a1fd-c855c3a237e7 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:17.470138 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32bcb1-b928-4772-a1fd-c855c3a237e7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:17.470706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32bcb1-b928-4772-a1fd-c855c3a237e7 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:17.472306 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 120/244] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:17.484939 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bdcb3-063c-457b-9694-5a62cab562e0 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:17.485565 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bdcb3-063c-457b-9694-5a62cab562e0 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:17.486081 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bdcb3-063c-457b-9694-5a62cab562e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:17.520067 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-b39bdcb3-063c-457b-9694-5a62cab562e0 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:17.521618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-b39bdcb3-063c-457b-9694-5a62cab562e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:17.576823 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 125/245] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:17.583777 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a81ef-2c6a-4a6d-bb80-0f23db39a204 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:17.677940 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 121/246] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:17.715746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bdcb3-063c-457b-9694-5a62cab562e0 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:17.740119 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:17.762967 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:17.770892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a81ef-2c6a-4a6d-bb80-0f23db39a204 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:17.813886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50949c-85ce-4cd2-9fec-3fd23524ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:17.814814 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50949c-85ce-4cd2-9fec-3fd23524ff4d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:17.815098 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50949c-85ce-4cd2-9fec-3fd23524ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:17.815375 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50949c-85ce-4cd2-9fec-3fd23524ff4d None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:17.816749 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50949c-85ce-4cd2-9fec-3fd23524ff4d None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:17.819290 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50949c-85ce-4cd2-9fec-3fd23524ff4d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:17.821324 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 126/247] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:17 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:17.827377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50949c-85ce-4cd2-9fec-3fd23524ff4d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:17.865959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bdcb3-063c-457b-9694-5a62cab562e0 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:17.927575 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7c846-c2b3-4bb5-94da-5b671b41c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:17.928454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7c846-c2b3-4bb5-94da-5b671b41c104 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:17.928686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7c846-c2b3-4bb5-94da-5b671b41c104 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:17.928965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7c846-c2b3-4bb5-94da-5b671b41c104 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:17.944963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7c846-c2b3-4bb5-94da-5b671b41c104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-2cd7c846-c2b3-4bb5-94da-5b671b41c104 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:17.954425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:17.955302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:17.956079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:17.956669 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 122/248] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:17.961900 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7c846-c2b3-4bb5-94da-5b671b41c104 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:17.982280 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50949c-85ce-4cd2-9fec-3fd23524ff4d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:18.021071 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f318e-fd2b-44ee-a965-2c76d4ecc665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:18.021742 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f318e-fd2b-44ee-a965-2c76d4ecc665 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:18.022080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f318e-fd2b-44ee-a965-2c76d4ecc665 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:18.022396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f318e-fd2b-44ee-a965-2c76d4ecc665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:18.023244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f318e-fd2b-44ee-a965-2c76d4ecc665 None admin] RBAC: Adding query filter params (role.id=c10458d8928f42bdb48358e0b4ca344e, scope.project.id=d5ac856d373a44118058b6acc934e6e4, user.id=55fc4dfc1a1a438faf88edec7acac37f) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:18.023561 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f318e-fd2b-44ee-a965-2c76d4ecc665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:18.025127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f318e-fd2b-44ee-a965-2c76d4ecc665 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:18.034081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 127/249] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:17 2022] GET /identity/v3/role_assignments?user.id=55fc4dfc1a1a438faf88edec7acac37f&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=c10458d8928f42bdb48358e0b4ca344e => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:18.045617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:18.076252 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7c846-c2b3-4bb5-94da-5b671b41c104 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:18.114965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b101eb4-7da3-4b5c-b853-cd26e0356751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:18.115663 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b101eb4-7da3-4b5c-b853-cd26e0356751 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:18.115954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b101eb4-7da3-4b5c-b853-cd26e0356751 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:18.116238 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b101eb4-7da3-4b5c-b853-cd26e0356751 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:18.117026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b101eb4-7da3-4b5c-b853-cd26e0356751 None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:18.117438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b101eb4-7da3-4b5c-b853-cd26e0356751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:18.119601 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b101eb4-7da3-4b5c-b853-cd26e0356751 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:18.129780 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 123/250] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:18.135645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f318e-fd2b-44ee-a965-2c76d4ecc665 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:18.177585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:18.265053 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f318e-fd2b-44ee-a965-2c76d4ecc665 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:18.311673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4d3e5-e394-4d13-b163-1a5a0e2e90eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:18.312873 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4d3e5-e394-4d13-b163-1a5a0e2e90eb None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:18.313437 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4d3e5-e394-4d13-b163-1a5a0e2e90eb None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:18.313893 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4d3e5-e394-4d13-b163-1a5a0e2e90eb None admin] PATH_INFO: `/v3/users/6648d442daf24a4bb97bc39b10361655` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:18.315399 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4d3e5-e394-4d13-b163-1a5a0e2e90eb None admin] RBAC: Authorizing `identity:get_user(user_id=6648d442daf24a4bb97bc39b10361655)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:18.317047 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4d3e5-e394-4d13-b163-1a5a0e2e90eb None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:18.319038 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 128/251] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:18 2022] GET /identity/v3/users/6648d442daf24a4bb97bc39b10361655 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:18.324800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b101eb4-7da3-4b5c-b853-cd26e0356751 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:18.435921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b101eb4-7da3-4b5c-b853-cd26e0356751 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:18.479182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed3956-72f1-4510-8143-474af7c8e267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:18.480358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed3956-72f1-4510-8143-474af7c8e267 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:18.480865 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed3956-72f1-4510-8143-474af7c8e267 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:18.481348 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed3956-72f1-4510-8143-474af7c8e267 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:18.482923 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed3956-72f1-4510-8143-474af7c8e267 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:18.484645 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed3956-72f1-4510-8143-474af7c8e267 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:18.486885 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 124/252] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:18 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:18.492643 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4d3e5-e394-4d13-b163-1a5a0e2e90eb None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:18.621621 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:18.628634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4d3e5-e394-4d13-b163-1a5a0e2e90eb None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:18.669938 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598469a-ee4f-4ccb-8d3d-73a0b9e4f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:18.671171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598469a-ee4f-4ccb-8d3d-73a0b9e4f329 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:18.671639 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598469a-ee4f-4ccb-8d3d-73a0b9e4f329 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:18.672122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598469a-ee4f-4ccb-8d3d-73a0b9e4f329 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4/users/6648d442daf24a4bb97bc39b10361655/roles/030683e4ff8d4d1587d99164f75c0fb8` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:18.679867 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598469a-ee4f-4ccb-8d3d-73a0b9e4f329 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ac856d373a44118058b6acc934e6e4, user_id=6648d442daf24a4bb97bc39b10361655, role_id=030683e4ff8d4d1587d99164f75c0fb8)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:18.681629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598469a-ee4f-4ccb-8d3d-73a0b9e4f329 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:18.752153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ddf54-c17d-4d6b-9e9c-a03920645d57 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:18.752727 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ddf54-c17d-4d6b-9e9c-a03920645d57 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:18.753221 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ddf54-c17d-4d6b-9e9c-a03920645d57 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:18.754804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 125/253] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:18.760252 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32de168-f977-4db8-b410-803594701b03 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:18.760741 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32de168-f977-4db8-b410-803594701b03 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:18.761198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32de168-f977-4db8-b410-803594701b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:18.771500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:18.784746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-b32de168-f977-4db8-b410-803594701b03 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:18.785966 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-b32de168-f977-4db8-b410-803594701b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:18.800963 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 129/254] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:56:18 2022] PUT /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4/users/6648d442daf24a4bb97bc39b10361655/roles/030683e4ff8d4d1587d99164f75c0fb8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:18.894721 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 126/255] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:18.927221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598469a-ee4f-4ccb-8d3d-73a0b9e4f329 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:19.006688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaf8f3-d535-4c03-a8a9-c72de71e34d7 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:19.007014 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaf8f3-d535-4c03-a8a9-c72de71e34d7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:19.007262 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaf8f3-d535-4c03-a8a9-c72de71e34d7 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:19.008641 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 127/256] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:19.015524 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62d15b-009a-4480-ac49-38714803cbd8 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:19.015821 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62d15b-009a-4480-ac49-38714803cbd8 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:19.016105 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62d15b-009a-4480-ac49-38714803cbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:19.043609 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-1a62d15b-009a-4480-ac49-38714803cbd8 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:19.044816 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-1a62d15b-009a-4480-ac49-38714803cbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:19.100032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598469a-ee4f-4ccb-8d3d-73a0b9e4f329 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:19.168702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 128/257] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:19.175069 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbede38b-c13c-4635-b911-697acc8cca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:19.175912 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbede38b-c13c-4635-b911-697acc8cca2c None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:19.176195 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbede38b-c13c-4635-b911-697acc8cca2c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:19.176470 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbede38b-c13c-4635-b911-697acc8cca2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:19.191760 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbede38b-c13c-4635-b911-697acc8cca2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-fbede38b-c13c-4635-b911-697acc8cca2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:19.205005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:19.205973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:19.206844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 130/258] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:19.214037 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62d15b-009a-4480-ac49-38714803cbd8 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:19.231422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbede38b-c13c-4635-b911-697acc8cca2c None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:19.267371 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:19.343806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:19.411631 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62d15b-009a-4480-ac49-38714803cbd8 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:19.426369 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbede38b-c13c-4635-b911-697acc8cca2c None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:19.479829 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541025c-89af-48f1-b989-74468b224a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:19.480635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541025c-89af-48f1-b989-74468b224a7e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:19.480914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541025c-89af-48f1-b989-74468b224a7e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:19.481188 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541025c-89af-48f1-b989-74468b224a7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:19.487729 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35bdaa-56ba-4404-b2a9-3174bf12921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:19.493143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35bdaa-56ba-4404-b2a9-3174bf12921b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:19.493143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35bdaa-56ba-4404-b2a9-3174bf12921b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:19.493143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35bdaa-56ba-4404-b2a9-3174bf12921b None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:19.493143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35bdaa-56ba-4404-b2a9-3174bf12921b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:19.493143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35bdaa-56ba-4404-b2a9-3174bf12921b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:19.493143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35bdaa-56ba-4404-b2a9-3174bf12921b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:19.499432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541025c-89af-48f1-b989-74468b224a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:19.504473 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 129/259] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-9541025c-89af-48f1-b989-74468b224a7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:19.507851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:19.509540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:19.510428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:19.511358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35bdaa-56ba-4404-b2a9-3174bf12921b None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:19.514492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 131/260] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:56:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:19.515579 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541025c-89af-48f1-b989-74468b224a7e None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:19.635015 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:19.662405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541025c-89af-48f1-b989-74468b224a7e None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:19.698349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c926d9-62ac-441e-a226-af03b7361a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:19.698959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c926d9-62ac-441e-a226-af03b7361a11 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:19.699245 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c926d9-62ac-441e-a226-af03b7361a11 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:19.699525 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c926d9-62ac-441e-a226-af03b7361a11 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:19.700285 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c926d9-62ac-441e-a226-af03b7361a11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:19.700593 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c926d9-62ac-441e-a226-af03b7361a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:19.701988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c926d9-62ac-441e-a226-af03b7361a11 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:19.710937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 132/261] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:19.716303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c926d9-62ac-441e-a226-af03b7361a11 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:19.742322 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35bdaa-56ba-4404-b2a9-3174bf12921b None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:19.802406 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:19.829190 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a25d14-6674-4870-93e6-e88bcc210560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:19.830091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a25d14-6674-4870-93e6-e88bcc210560 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:19.830402 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a25d14-6674-4870-93e6-e88bcc210560 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:19.830687 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a25d14-6674-4870-93e6-e88bcc210560 None admin] PATH_INFO: `/v3/users/ea3c4331becf4f81814cd775b4bbe7fe` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:19.832031 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a25d14-6674-4870-93e6-e88bcc210560 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3c4331becf4f81814cd775b4bbe7fe)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:19.833551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a25d14-6674-4870-93e6-e88bcc210560 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:19.835424 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 130/262] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:19 2022] GET /identity/v3/users/ea3c4331becf4f81814cd775b4bbe7fe => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:19.841005 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a25d14-6674-4870-93e6-e88bcc210560 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:19.847900 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c926d9-62ac-441e-a226-af03b7361a11 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:19.885623 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097c4e-744f-46d2-a55f-7e2a72748e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:19.887815 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097c4e-744f-46d2-a55f-7e2a72748e18 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:19.888105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097c4e-744f-46d2-a55f-7e2a72748e18 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:19.889148 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097c4e-744f-46d2-a55f-7e2a72748e18 None admin] PATH_INFO: `/v3/users/ea3c4331becf4f81814cd775b4bbe7fe` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:19.890978 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8097c4e-744f-46d2-a55f-7e2a72748e18 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3c4331becf4f81814cd775b4bbe7fe)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:19.892422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8097c4e-744f-46d2-a55f-7e2a72748e18 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:19.894281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 133/263] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:19 2022] GET /identity/v3/users/ea3c4331becf4f81814cd775b4bbe7fe => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:19.901357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097c4e-744f-46d2-a55f-7e2a72748e18 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:19.926037 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:20.029446 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a25d14-6674-4870-93e6-e88bcc210560 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:20.068349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579404d7-e390-4a33-83d6-6455896c29c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:20.069397 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579404d7-e390-4a33-83d6-6455896c29c2 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:20.069560 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097c4e-744f-46d2-a55f-7e2a72748e18 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:20.069976 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579404d7-e390-4a33-83d6-6455896c29c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:20.070502 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579404d7-e390-4a33-83d6-6455896c29c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:20.116996 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c838e-78aa-48a1-bb2b-e9a5a0c51a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:20.117897 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c838e-78aa-48a1-bb2b-e9a5a0c51a35 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:20.119000 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c838e-78aa-48a1-bb2b-e9a5a0c51a35 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:20.119462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c838e-78aa-48a1-bb2b-e9a5a0c51a35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:20.138765 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:20.147017 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579404d7-e390-4a33-83d6-6455896c29c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:20.148804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579404d7-e390-4a33-83d6-6455896c29c2 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:20.194730 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c838e-78aa-48a1-bb2b-e9a5a0c51a35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:20.196734 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c838e-78aa-48a1-bb2b-e9a5a0c51a35 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:20.205195 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:20.261498 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 131/264] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:20.266629 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579404d7-e390-4a33-83d6-6455896c29c2 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:20.302937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 134/265] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:20.309370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c838e-78aa-48a1-bb2b-e9a5a0c51a35 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:20.367891 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:20.375711 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579404d7-e390-4a33-83d6-6455896c29c2 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:20.414166 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b467e4f-f170-4b75-9fb2-c3d4ff782ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:20.415930 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b467e4f-f170-4b75-9fb2-c3d4ff782ae4 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:20.416051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c838e-78aa-48a1-bb2b-e9a5a0c51a35 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:20.416486 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b467e4f-f170-4b75-9fb2-c3d4ff782ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:20.416914 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b467e4f-f170-4b75-9fb2-c3d4ff782ae4 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:20.418411 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b467e4f-f170-4b75-9fb2-c3d4ff782ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:20.420095 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b467e4f-f170-4b75-9fb2-c3d4ff782ae4 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:20.422459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 132/266] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:20 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:20.424289 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:20.431489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b467e4f-f170-4b75-9fb2-c3d4ff782ae4 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:20.452239 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d755f-7246-416b-a225-3e553c722e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:20.453065 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d755f-7246-416b-a225-3e553c722e6a None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:20.453472 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d755f-7246-416b-a225-3e553c722e6a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:20.453782 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d755f-7246-416b-a225-3e553c722e6a None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:20.455207 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d755f-7246-416b-a225-3e553c722e6a None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:20.457170 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d755f-7246-416b-a225-3e553c722e6a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:20.462714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 135/267] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:20 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:20.465556 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d755f-7246-416b-a225-3e553c722e6a None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:20.572312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d755f-7246-416b-a225-3e553c722e6a None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:20.593783 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b467e4f-f170-4b75-9fb2-c3d4ff782ae4 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:20.610354 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdfe53-a9a0-4aa6-9f93-3f3bbe4766a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:20.610354 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdfe53-a9a0-4aa6-9f93-3f3bbe4766a7 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:20.610354 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdfe53-a9a0-4aa6-9f93-3f3bbe4766a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:20.610354 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdfe53-a9a0-4aa6-9f93-3f3bbe4766a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:20.610756 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdfe53-a9a0-4aa6-9f93-3f3bbe4766a7 None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=d5ac856d373a44118058b6acc934e6e4, user.id=ea3c4331becf4f81814cd775b4bbe7fe) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:20.610756 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdfe53-a9a0-4aa6-9f93-3f3bbe4766a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:20.611756 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdfe53-a9a0-4aa6-9f93-3f3bbe4766a7 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:20.622427 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 136/268] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:20 2022] GET /identity/v3/role_assignments?user.id=ea3c4331becf4f81814cd775b4bbe7fe&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:20.655813 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02a155-3646-4f3d-9bd7-8bf6b379ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:20.656958 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a155-3646-4f3d-9bd7-8bf6b379ed7c None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:20.657515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a155-3646-4f3d-9bd7-8bf6b379ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:20.658008 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a155-3646-4f3d-9bd7-8bf6b379ed7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:20.659147 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02a155-3646-4f3d-9bd7-8bf6b379ed7c None admin] RBAC: Adding query filter params (role.id=33a7efc2edd44d81bc33bfd6d02c61cb, scope.project.id=d5ac856d373a44118058b6acc934e6e4, user.id=ea3c4331becf4f81814cd775b4bbe7fe) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:20.659680 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02a155-3646-4f3d-9bd7-8bf6b379ed7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:20.661357 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02a155-3646-4f3d-9bd7-8bf6b379ed7c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:20.669105 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 133/269] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:20 2022] GET /identity/v3/role_assignments?user.id=ea3c4331becf4f81814cd775b4bbe7fe&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=33a7efc2edd44d81bc33bfd6d02c61cb => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:21.297329 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c958-36ce-4eda-9f32-14b3d641e5b9 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:21.297669 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c958-36ce-4eda-9f32-14b3d641e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:21.297865 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c958-36ce-4eda-9f32-14b3d641e5b9 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:21.299203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 137/270] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:21.306105 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae4ff9-d6c7-4ded-a252-fed92f130623 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:21.306820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae4ff9-d6c7-4ded-a252-fed92f130623 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:21.307323 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae4ff9-d6c7-4ded-a252-fed92f130623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:21.325733 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-eaae4ff9-d6c7-4ded-a252-fed92f130623 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:21.327348 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-eaae4ff9-d6c7-4ded-a252-fed92f130623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:21.350522 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:21.402373 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 134/271] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:21.433001 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c958-36ce-4eda-9f32-14b3d641e5b9 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:21.479195 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:21.561483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c958-36ce-4eda-9f32-14b3d641e5b9 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:21.600343 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b0bb6-040a-4643-b716-5d9777e7abb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:21.601149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b0bb6-040a-4643-b716-5d9777e7abb6 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:21.601438 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b0bb6-040a-4643-b716-5d9777e7abb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:21.601720 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b0bb6-040a-4643-b716-5d9777e7abb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:21.612957 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b0bb6-040a-4643-b716-5d9777e7abb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-633b0bb6-040a-4643-b716-5d9777e7abb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:21.621246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:21.622128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:21.623424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 138/272] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:21.630847 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae4ff9-d6c7-4ded-a252-fed92f130623 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:21.631450 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ab38-afd7-426c-b645-5dc787b5744a None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:21.631747 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ab38-afd7-426c-b645-5dc787b5744a None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:21.632033 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ab38-afd7-426c-b645-5dc787b5744a None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:21.633512 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 139/273] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:21.638959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0e126-044f-440a-92f3-766d828645d7 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:21.639250 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0e126-044f-440a-92f3-766d828645d7 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:21.639536 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0e126-044f-440a-92f3-766d828645d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:21.657336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-5bb0e126-044f-440a-92f3-766d828645d7 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:21.658578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-5bb0e126-044f-440a-92f3-766d828645d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:21.732811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 140/274] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:21.738569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc3c04-8a01-43b2-b1d5-835227de2822 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:21.738569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc3c04-8a01-43b2-b1d5-835227de2822 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:21.738569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc3c04-8a01-43b2-b1d5-835227de2822 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:21.738569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 141/275] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:21.741659 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4601a4-6ba3-4fc5-a5cb-8376fabc5c20 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:21.742103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4601a4-6ba3-4fc5-a5cb-8376fabc5c20 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:21.742561 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4601a4-6ba3-4fc5-a5cb-8376fabc5c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:21.761073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-ab4601a4-6ba3-4fc5-a5cb-8376fabc5c20 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:21.762794 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-ab4601a4-6ba3-4fc5-a5cb-8376fabc5c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:21.765621 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae4ff9-d6c7-4ded-a252-fed92f130623 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:21.786781 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:21.803957 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467ce6b-fdd7-466a-99c1-82204d613975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:21.804988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467ce6b-fdd7-466a-99c1-82204d613975 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:21.805479 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467ce6b-fdd7-466a-99c1-82204d613975 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:21.806658 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467ce6b-fdd7-466a-99c1-82204d613975 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:21.807425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467ce6b-fdd7-466a-99c1-82204d613975 None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:21.807742 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467ce6b-fdd7-466a-99c1-82204d613975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:21.809317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467ce6b-fdd7-466a-99c1-82204d613975 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:21.818797 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 135/276] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:21.819461 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467ce6b-fdd7-466a-99c1-82204d613975 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:21.839745 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 142/277] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:21.845998 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:21.851504 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4601a4-6ba3-4fc5-a5cb-8376fabc5c20 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:21.951857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467ce6b-fdd7-466a-99c1-82204d613975 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:21.985603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4601a4-6ba3-4fc5-a5cb-8376fabc5c20 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:21.989869 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba0f8-9b55-49ca-8334-df8bf332e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:21.990790 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba0f8-9b55-49ca-8334-df8bf332e507 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:21.991084 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba0f8-9b55-49ca-8334-df8bf332e507 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:21.991364 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba0f8-9b55-49ca-8334-df8bf332e507 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:21.992567 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ba0f8-9b55-49ca-8334-df8bf332e507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:21.994575 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ba0f8-9b55-49ca-8334-df8bf332e507 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:22.001143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 136/278] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:22.001143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba0f8-9b55-49ca-8334-df8bf332e507 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:22.022775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4577f0-291d-4769-b6f1-6a13ccb4e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:22.023697 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4577f0-291d-4769-b6f1-6a13ccb4e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.024057 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4577f0-291d-4769-b6f1-6a13ccb4e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.024885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4577f0-291d-4769-b6f1-6a13ccb4e4b3 None admin] PATH_INFO: `/v3/users/23ec3537b6a54bd9ad6d0ccff7d60495` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.039759 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4577f0-291d-4769-b6f1-6a13ccb4e4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=23ec3537b6a54bd9ad6d0ccff7d60495)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:22.042046 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4577f0-291d-4769-b6f1-6a13ccb4e4b3 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:22.043834 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 143/279] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:21 2022] GET /identity/v3/users/23ec3537b6a54bd9ad6d0ccff7d60495 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:22.048603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4577f0-291d-4769-b6f1-6a13ccb4e4b3 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:22.065103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:22.109062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:22.132332 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba0f8-9b55-49ca-8334-df8bf332e507 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:22.152685 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4577f0-291d-4769-b6f1-6a13ccb4e4b3 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:22.178446 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1290af-a7cd-48f5-9c71-17b6342a7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:22.179401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1290af-a7cd-48f5-9c71-17b6342a7658 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.179692 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1290af-a7cd-48f5-9c71-17b6342a7658 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.180270 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1290af-a7cd-48f5-9c71-17b6342a7658 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.187386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f01fdb-b52c-4b20-a8a2-9afbb247d06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:22.188058 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f01fdb-b52c-4b20-a8a2-9afbb247d06d None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.188346 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f01fdb-b52c-4b20-a8a2-9afbb247d06d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.188626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f01fdb-b52c-4b20-a8a2-9afbb247d06d None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.189340 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f01fdb-b52c-4b20-a8a2-9afbb247d06d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:22.190827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f01fdb-b52c-4b20-a8a2-9afbb247d06d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:22.191814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1290af-a7cd-48f5-9c71-17b6342a7658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-3d1290af-a7cd-48f5-9c71-17b6342a7658 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:22.200913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:22.201819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 137/280] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:22.212705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1290af-a7cd-48f5-9c71-17b6342a7658 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:22.269748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 144/281] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:56:22 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:22.279662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f01fdb-b52c-4b20-a8a2-9afbb247d06d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:22.313811 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1290af-a7cd-48f5-9c71-17b6342a7658 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:22.355678 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01011524-f8ae-44e4-a2e7-2c40a38fe2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:22.356722 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011524-f8ae-44e4-a2e7-2c40a38fe2b8 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.357199 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011524-f8ae-44e4-a2e7-2c40a38fe2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.357661 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011524-f8ae-44e4-a2e7-2c40a38fe2b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.358729 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011524-f8ae-44e4-a2e7-2c40a38fe2b8 None admin] RBAC: Adding query filter params (role.id=030683e4ff8d4d1587d99164f75c0fb8, user.id=23ec3537b6a54bd9ad6d0ccff7d60495, scope.system=all) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:22.359352 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011524-f8ae-44e4-a2e7-2c40a38fe2b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:22.361217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011524-f8ae-44e4-a2e7-2c40a38fe2b8 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:22.367593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 138/282] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Jun 6 06:56:22 2022] GET /identity/v3/role_assignments?user.id=23ec3537b6a54bd9ad6d0ccff7d60495&scope.system=all&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:22.380644 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:22.418232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f01fdb-b52c-4b20-a8a2-9afbb247d06d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:22.441295 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3b313-4fec-496a-b65b-a5982db908a9 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.441913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3b313-4fec-496a-b65b-a5982db908a9 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.442456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3b313-4fec-496a-b65b-a5982db908a9 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.444589 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 139/283] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:22.453062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f266c2-1773-4193-aa73-7f17bbabd0f7 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.453729 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f266c2-1773-4193-aa73-7f17bbabd0f7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.454223 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f266c2-1773-4193-aa73-7f17bbabd0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.459722 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df554b7-a521-48fc-9677-cac9ed05de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:22.460487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df554b7-a521-48fc-9677-cac9ed05de99 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.460776 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df554b7-a521-48fc-9677-cac9ed05de99 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.461116 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df554b7-a521-48fc-9677-cac9ed05de99 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.462546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df554b7-a521-48fc-9677-cac9ed05de99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:22.462874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df554b7-a521-48fc-9677-cac9ed05de99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:22.464371 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df554b7-a521-48fc-9677-cac9ed05de99 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:22.474300 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 145/284] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:22.481758 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-48f266c2-1773-4193-aa73-7f17bbabd0f7 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:22.483194 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-48f266c2-1773-4193-aa73-7f17bbabd0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:22.486393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df554b7-a521-48fc-9677-cac9ed05de99 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:22.487367 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:22.579136 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 140/285] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:22.604806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f266c2-1773-4193-aa73-7f17bbabd0f7 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:22.628910 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df554b7-a521-48fc-9677-cac9ed05de99 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:22.676914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaa74a-5dfe-410f-990d-e0a552b5b8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:22.678380 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaa74a-5dfe-410f-990d-e0a552b5b8a0 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.678878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaa74a-5dfe-410f-990d-e0a552b5b8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.679364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaa74a-5dfe-410f-990d-e0a552b5b8a0 None admin] PATH_INFO: `/v3/users/55fc4dfc1a1a438faf88edec7acac37f` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.682475 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaa74a-5dfe-410f-990d-e0a552b5b8a0 None admin] RBAC: Authorizing `identity:get_user(user_id=55fc4dfc1a1a438faf88edec7acac37f)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:22.684433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaa74a-5dfe-410f-990d-e0a552b5b8a0 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:22.687358 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 146/286] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:22 2022] GET /identity/v3/users/55fc4dfc1a1a438faf88edec7acac37f => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:22.693044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaa74a-5dfe-410f-990d-e0a552b5b8a0 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:22.696084 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:22.732369 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f266c2-1773-4193-aa73-7f17bbabd0f7 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:22.770106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cee8a6-05ff-4b68-b515-484091011f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:22.771259 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cee8a6-05ff-4b68-b515-484091011f10 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.771728 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cee8a6-05ff-4b68-b515-484091011f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.772223 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cee8a6-05ff-4b68-b515-484091011f10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.783633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cee8a6-05ff-4b68-b515-484091011f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-43cee8a6-05ff-4b68-b515-484091011f10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:22.792739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:22.793627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:22.794452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:22.797151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 141/287] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:22.798548 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:22.803017 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cee8a6-05ff-4b68-b515-484091011f10 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:22.804197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaa74a-5dfe-410f-990d-e0a552b5b8a0 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:22.841224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18635cc1-fbc0-4596-8c95-f923af3b0225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:22.842105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635cc1-fbc0-4596-8c95-f923af3b0225 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.842417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635cc1-fbc0-4596-8c95-f923af3b0225 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.842700 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635cc1-fbc0-4596-8c95-f923af3b0225 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.843910 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18635cc1-fbc0-4596-8c95-f923af3b0225 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:22.845452 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18635cc1-fbc0-4596-8c95-f923af3b0225 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:22.847405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 147/288] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:22 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:22.853221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18635cc1-fbc0-4596-8c95-f923af3b0225 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:22.931437 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cee8a6-05ff-4b68-b515-484091011f10 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:22.962401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:22.991739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff88f-cdcd-4750-abea-901623bdc293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:22.992415 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff88f-cdcd-4750-abea-901623bdc293 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:22.992703 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff88f-cdcd-4750-abea-901623bdc293 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:22.993001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff88f-cdcd-4750-abea-901623bdc293 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:22.994351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ff88f-cdcd-4750-abea-901623bdc293 None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:22.994664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ff88f-cdcd-4750-abea-901623bdc293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:22.996179 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ff88f-cdcd-4750-abea-901623bdc293 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:23.018156 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 142/289] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:23.023303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18635cc1-fbc0-4596-8c95-f923af3b0225 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:23.025602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff88f-cdcd-4750-abea-901623bdc293 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:23.095036 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf49981-1f35-41b1-9588-d002134d8eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:23.095937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf49981-1f35-41b1-9588-d002134d8eeb None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:23.096221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf49981-1f35-41b1-9588-d002134d8eeb None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:23.096501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf49981-1f35-41b1-9588-d002134d8eeb None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4/users/55fc4dfc1a1a438faf88edec7acac37f/roles/c10458d8928f42bdb48358e0b4ca344e` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:23.103290 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:23.104356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf49981-1f35-41b1-9588-d002134d8eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ac856d373a44118058b6acc934e6e4, user_id=55fc4dfc1a1a438faf88edec7acac37f, role_id=c10458d8928f42bdb48358e0b4ca344e)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:23.105817 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf49981-1f35-41b1-9588-d002134d8eeb None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:23.130994 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff88f-cdcd-4750-abea-901623bdc293 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:23.170773 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762f0d8-7faa-436b-b9a8-658164530635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:23.171631 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762f0d8-7faa-436b-b9a8-658164530635 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:23.171975 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762f0d8-7faa-436b-b9a8-658164530635 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:23.172259 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762f0d8-7faa-436b-b9a8-658164530635 None admin] PATH_INFO: `/v3/users/6648d442daf24a4bb97bc39b10361655` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:23.173543 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762f0d8-7faa-436b-b9a8-658164530635 None admin] RBAC: Authorizing `identity:get_user(user_id=6648d442daf24a4bb97bc39b10361655)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:23.175074 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762f0d8-7faa-436b-b9a8-658164530635 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:23.177104 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 143/290] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:23 2022] GET /identity/v3/users/6648d442daf24a4bb97bc39b10361655 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:23.187239 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762f0d8-7faa-436b-b9a8-658164530635 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:23.198394 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 148/291] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:56:22 2022] PUT /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4/users/55fc4dfc1a1a438faf88edec7acac37f/roles/c10458d8928f42bdb48358e0b4ca344e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:23.324636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762f0d8-7faa-436b-b9a8-658164530635 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:23.356982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:23.364118 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34abdd-e543-45fd-a7e6-1036a3816e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:23.365259 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34abdd-e543-45fd-a7e6-1036a3816e3d None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:23.365750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34abdd-e543-45fd-a7e6-1036a3816e3d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:23.366253 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34abdd-e543-45fd-a7e6-1036a3816e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:23.469559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34abdd-e543-45fd-a7e6-1036a3816e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:23.471401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34abdd-e543-45fd-a7e6-1036a3816e3d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:23.606492 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 144/292] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:23.611523 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf49981-1f35-41b1-9588-d002134d8eeb None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:23.739327 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf49981-1f35-41b1-9588-d002134d8eeb None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:23.771843 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:23.778708 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b2757-8ca2-4b73-8b5c-6f7b73f2f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:23.781372 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b2757-8ca2-4b73-8b5c-6f7b73f2f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:23.781658 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b2757-8ca2-4b73-8b5c-6f7b73f2f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:23.781939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b2757-8ca2-4b73-8b5c-6f7b73f2f7b5 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:23.783349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b2757-8ca2-4b73-8b5c-6f7b73f2f7b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:23.792229 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b2757-8ca2-4b73-8b5c-6f7b73f2f7b5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:23.792229 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 149/293] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:23 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:23.793506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34abdd-e543-45fd-a7e6-1036a3816e3d None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:23.835508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:23.936536 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34abdd-e543-45fd-a7e6-1036a3816e3d None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:23.979854 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798e100-8d69-4709-a55c-b9e05633f4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:23.980517 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e100-8d69-4709-a55c-b9e05633f4e1 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:23.980805 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e100-8d69-4709-a55c-b9e05633f4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:23.981082 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e100-8d69-4709-a55c-b9e05633f4e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:23.981913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798e100-8d69-4709-a55c-b9e05633f4e1 None admin] RBAC: Adding query filter params (role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=d5ac856d373a44118058b6acc934e6e4, user.id=6648d442daf24a4bb97bc39b10361655) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:23.982227 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798e100-8d69-4709-a55c-b9e05633f4e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:23.983701 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798e100-8d69-4709-a55c-b9e05633f4e1 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:23.995533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 145/294] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:23 2022] GET /identity/v3/role_assignments?user.id=6648d442daf24a4bb97bc39b10361655&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:24.893179 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa7209-4f8e-4fd5-8abc-08cf68fbf6c0 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:24.894271 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa7209-4f8e-4fd5-8abc-08cf68fbf6c0 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:24.894790 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa7209-4f8e-4fd5-8abc-08cf68fbf6c0 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:24.896605 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 150/295] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:24.902686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a9a3f-bd98-4ff2-9872-6e9493fd99a3 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:24.903581 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a9a3f-bd98-4ff2-9872-6e9493fd99a3 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:24.904100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a9a3f-bd98-4ff2-9872-6e9493fd99a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:24.928613 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-455a9a3f-bd98-4ff2-9872-6e9493fd99a3 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:24.930190 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-455a9a3f-bd98-4ff2-9872-6e9493fd99a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:25.009265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 146/296] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:25.032326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa7209-4f8e-4fd5-8abc-08cf68fbf6c0 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.093482 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1339a9e-484a-4455-975c-6d5637a161a6 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.093800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1339a9e-484a-4455-975c-6d5637a161a6 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.094060 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1339a9e-484a-4455-975c-6d5637a161a6 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.095888 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 147/297] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:25.100982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50fe6-5c0a-481f-9e82-3b17ac0306ee None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.101276 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50fe6-5c0a-481f-9e82-3b17ac0306ee None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.101557 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50fe6-5c0a-481f-9e82-3b17ac0306ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.123337 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-44c50fe6-5c0a-481f-9e82-3b17ac0306ee None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:25.124537 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-44c50fe6-5c0a-481f-9e82-3b17ac0306ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:25.153410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:25.160390 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa7209-4f8e-4fd5-8abc-08cf68fbf6c0 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:25.200756 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99abe6f-65f3-45f3-921c-2ccf01bfee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:25.203337 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99abe6f-65f3-45f3-921c-2ccf01bfee23 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.203847 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99abe6f-65f3-45f3-921c-2ccf01bfee23 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.204309 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99abe6f-65f3-45f3-921c-2ccf01bfee23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.230085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99abe6f-65f3-45f3-921c-2ccf01bfee23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:25.235053 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 148/298] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-b99abe6f-65f3-45f3-921c-2ccf01bfee23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:25.241925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:25.242841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:25.244164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:25.246806 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 151/299] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:25.254382 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50fe6-5c0a-481f-9e82-3b17ac0306ee None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.264359 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99abe6f-65f3-45f3-921c-2ccf01bfee23 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.337369 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:25.370664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50fe6-5c0a-481f-9e82-3b17ac0306ee None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:25.383459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99abe6f-65f3-45f3-921c-2ccf01bfee23 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:25.407513 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a0043-584c-4980-a659-45e201f79bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:25.408116 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a0043-584c-4980-a659-45e201f79bc9 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.408408 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a0043-584c-4980-a659-45e201f79bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.408693 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a0043-584c-4980-a659-45e201f79bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.409449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a0043-584c-4980-a659-45e201f79bc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:25.409763 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a0043-584c-4980-a659-45e201f79bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:25.411185 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a0043-584c-4980-a659-45e201f79bc9 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:25.418489 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee967a5-862c-4c15-85b7-432b12f38c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:25.419281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee967a5-862c-4c15-85b7-432b12f38c60 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.419561 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee967a5-862c-4c15-85b7-432b12f38c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.420035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 149/300] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:25.420137 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee967a5-862c-4c15-85b7-432b12f38c60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.420988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdb6ba-88ae-4885-99e2-3bd015ce0789 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.421284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdb6ba-88ae-4885-99e2-3bd015ce0789 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.421573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdb6ba-88ae-4885-99e2-3bd015ce0789 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.422966 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 150/301] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:25.425540 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdb6ba-88ae-4885-99e2-3bd015ce0789 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.433684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee967a5-862c-4c15-85b7-432b12f38c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-3ee967a5-862c-4c15-85b7-432b12f38c60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:25.441383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:25.442257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:25.443122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 152/302] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:25.444636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df166fb-f8e6-4d9f-8921-c584fe804654 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.444636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df166fb-f8e6-4d9f-8921-c584fe804654 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.444636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df166fb-f8e6-4d9f-8921-c584fe804654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.449789 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:25.461044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-2df166fb-f8e6-4d9f-8921-c584fe804654 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:25.462270 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-2df166fb-f8e6-4d9f-8921-c584fe804654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:25.533460 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 153/303] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:25.534314 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df166fb-f8e6-4d9f-8921-c584fe804654 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.551237 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdb6ba-88ae-4885-99e2-3bd015ce0789 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:25.587210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:25.593882 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e5760-8730-465c-be63-83d0e0b806d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:25.598454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e5760-8730-465c-be63-83d0e0b806d7 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.598454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e5760-8730-465c-be63-83d0e0b806d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.598454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e5760-8730-465c-be63-83d0e0b806d7 None admin] PATH_INFO: `/v3/users/23ec3537b6a54bd9ad6d0ccff7d60495` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.598454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e5760-8730-465c-be63-83d0e0b806d7 None admin] RBAC: Authorizing `identity:get_user(user_id=23ec3537b6a54bd9ad6d0ccff7d60495)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:25.598454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e5760-8730-465c-be63-83d0e0b806d7 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:25.600483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 151/304] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:25 2022] GET /identity/v3/users/23ec3537b6a54bd9ad6d0ccff7d60495 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:25.601199 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e5760-8730-465c-be63-83d0e0b806d7 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.650986 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df166fb-f8e6-4d9f-8921-c584fe804654 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:25.685306 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d682eb-896b-4c8a-878f-a643446d94c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:25.686271 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d682eb-896b-4c8a-878f-a643446d94c8 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.686754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d682eb-896b-4c8a-878f-a643446d94c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.687188 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d682eb-896b-4c8a-878f-a643446d94c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.688227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d682eb-896b-4c8a-878f-a643446d94c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:25.688540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d682eb-896b-4c8a-878f-a643446d94c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:25.689972 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d682eb-896b-4c8a-878f-a643446d94c8 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:25.699553 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 154/305] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:25.699974 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d682eb-896b-4c8a-878f-a643446d94c8 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.707502 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:25.726792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e5760-8730-465c-be63-83d0e0b806d7 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:25.763490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc0706-63db-4a51-94b8-6ef9fb057008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:25.764555 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc0706-63db-4a51-94b8-6ef9fb057008 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.765004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc0706-63db-4a51-94b8-6ef9fb057008 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.765286 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc0706-63db-4a51-94b8-6ef9fb057008 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.766516 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc0706-63db-4a51-94b8-6ef9fb057008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:25.767991 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc0706-63db-4a51-94b8-6ef9fb057008 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:25.769778 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 152/306] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:25.770520 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc0706-63db-4a51-94b8-6ef9fb057008 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.818293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d682eb-896b-4c8a-878f-a643446d94c8 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:25.828955 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:25.854170 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aae1d-f725-401d-9c81-6b581900e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:25.855120 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aae1d-f725-401d-9c81-6b581900e06b None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.855843 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aae1d-f725-401d-9c81-6b581900e06b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.856231 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aae1d-f725-401d-9c81-6b581900e06b None admin] PATH_INFO: `/v3/system/users/23ec3537b6a54bd9ad6d0ccff7d60495/roles/030683e4ff8d4d1587d99164f75c0fb8` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.858280 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aae1d-f725-401d-9c81-6b581900e06b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=23ec3537b6a54bd9ad6d0ccff7d60495, role_id=030683e4ff8d4d1587d99164f75c0fb8)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:25.860796 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aae1d-f725-401d-9c81-6b581900e06b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:25.883042 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc0706-63db-4a51-94b8-6ef9fb057008 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:25.917432 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7f2e8-b13d-4f16-9c8b-2c22600eba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:25.918317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7f2e8-b13d-4f16-9c8b-2c22600eba41 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:25.918642 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7f2e8-b13d-4f16-9c8b-2c22600eba41 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:25.918926 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7f2e8-b13d-4f16-9c8b-2c22600eba41 None admin] PATH_INFO: `/v3/users/80572a011fc84842a4dc9f3d68f93f29` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:25.936128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7f2e8-b13d-4f16-9c8b-2c22600eba41 None admin] RBAC: Authorizing `identity:get_user(user_id=80572a011fc84842a4dc9f3d68f93f29)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:25.938319 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7f2e8-b13d-4f16-9c8b-2c22600eba41 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:25.940385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 153/307] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:25 2022] GET /identity/v3/users/80572a011fc84842a4dc9f3d68f93f29 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:25.940982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7f2e8-b13d-4f16-9c8b-2c22600eba41 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.950011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 155/308] 10.222.0.42 () {58 vars in 1334 bytes} [Mon Jun 6 06:56:25 2022] PUT /identity/v3/system/users/23ec3537b6a54bd9ad6d0ccff7d60495/roles/030683e4ff8d4d1587d99164f75c0fb8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:25.951741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aae1d-f725-401d-9c81-6b581900e06b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:25.958141 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:26.086534 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7f2e8-b13d-4f16-9c8b-2c22600eba41 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:26.087602 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aae1d-f725-401d-9c81-6b581900e06b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:26.128087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c2dae-bbdf-4277-8130-609496fa514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:26.129240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2dae-bbdf-4277-8130-609496fa514e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:26.129706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2dae-bbdf-4277-8130-609496fa514e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:26.130210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2dae-bbdf-4277-8130-609496fa514e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:26.131463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c2dae-bbdf-4277-8130-609496fa514e None admin] RBAC: Adding query filter params (role.id=c10458d8928f42bdb48358e0b4ca344e, user.id=80572a011fc84842a4dc9f3d68f93f29, scope.system=all) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:26.131989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c2dae-bbdf-4277-8130-609496fa514e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:26.132093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8d501-04df-407b-b4b3-83670b615b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:26.132833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d501-04df-407b-b4b3-83670b615b43 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:26.133188 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d501-04df-407b-b4b3-83670b615b43 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:26.134088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d501-04df-407b-b4b3-83670b615b43 None admin] PATH_INFO: `/v3/groups` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:26.134899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8d501-04df-407b-b4b3-83670b615b43 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:26.135096 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c2dae-bbdf-4277-8130-609496fa514e None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:26.136492 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8d501-04df-407b-b4b3-83670b615b43 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:26.142045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 156/309] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Jun 6 06:56:25 2022] GET /identity/v3/role_assignments?user.id=80572a011fc84842a4dc9f3d68f93f29&scope.system=all&role.id=c10458d8928f42bdb48358e0b4ca344e => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:26.224483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 154/310] 10.222.0.42 () {60 vars in 1134 bytes} [Mon Jun 6 06:56:25 2022] POST /identity/v3/groups => generated 229 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:26.307427 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d27f-7fe3-432a-b319-91d1ccb7a149 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:26.307720 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d27f-7fe3-432a-b319-91d1ccb7a149 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:26.308012 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d27f-7fe3-432a-b319-91d1ccb7a149 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:26.309524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 157/311] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:26.315853 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f767ece-e6f5-448b-ba13-88f3a6d3e35a None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:26.316169 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f767ece-e6f5-448b-ba13-88f3a6d3e35a None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:26.316439 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f767ece-e6f5-448b-ba13-88f3a6d3e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:26.335806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-8f767ece-e6f5-448b-ba13-88f3a6d3e35a None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:26.337978 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-8f767ece-e6f5-448b-ba13-88f3a6d3e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:26.414894 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:26.421272 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 155/312] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:26.446161 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d27f-7fe3-432a-b319-91d1ccb7a149 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:26.497115 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:26.565714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d27f-7fe3-432a-b319-91d1ccb7a149 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:26.604787 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2a772-3451-4ebf-b541-be38f3c12065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:26.605822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2a772-3451-4ebf-b541-be38f3c12065 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:26.606278 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2a772-3451-4ebf-b541-be38f3c12065 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:26.606879 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2a772-3451-4ebf-b541-be38f3c12065 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:26.617939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2a772-3451-4ebf-b541-be38f3c12065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-f2b2a772-3451-4ebf-b541-be38f3c12065 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:26.625960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:26.627308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:26.628298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:26.630653 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 158/313] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:26.642387 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f767ece-e6f5-448b-ba13-88f3a6d3e35a None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:26.738784 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f767ece-e6f5-448b-ba13-88f3a6d3e35a None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:26.779405 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c5e2-7fed-4919-83ab-9b8e690c3c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:26.780005 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c5e2-7fed-4919-83ab-9b8e690c3c4f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:26.780293 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c5e2-7fed-4919-83ab-9b8e690c3c4f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:26.780575 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c5e2-7fed-4919-83ab-9b8e690c3c4f None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:26.781334 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652c5e2-7fed-4919-83ab-9b8e690c3c4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:26.781647 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652c5e2-7fed-4919-83ab-9b8e690c3c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:26.783063 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652c5e2-7fed-4919-83ab-9b8e690c3c4f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:26.792393 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 156/314] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:26.797655 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2a772-3451-4ebf-b541-be38f3c12065 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:26.900818 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:26.905251 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2a772-3451-4ebf-b541-be38f3c12065 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:26.939715 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1baca9-3c03-4bd9-a7c9-d35ec46b4585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:26.940592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1baca9-3c03-4bd9-a7c9-d35ec46b4585 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:26.940873 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1baca9-3c03-4bd9-a7c9-d35ec46b4585 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:26.941147 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1baca9-3c03-4bd9-a7c9-d35ec46b4585 None admin] PATH_INFO: `/v3/users/55fc4dfc1a1a438faf88edec7acac37f` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:26.942663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1baca9-3c03-4bd9-a7c9-d35ec46b4585 None admin] RBAC: Authorizing `identity:get_user(user_id=55fc4dfc1a1a438faf88edec7acac37f)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:26.944706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1baca9-3c03-4bd9-a7c9-d35ec46b4585 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:26.947064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 159/315] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:26 2022] GET /identity/v3/users/55fc4dfc1a1a438faf88edec7acac37f => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:26.952685 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c5e2-7fed-4919-83ab-9b8e690c3c4f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:27.032675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:27.073521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c5e2-7fed-4919-83ab-9b8e690c3c4f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:27.108899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f052ab9-74eb-44c9-896e-28f36daa424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:27.109560 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052ab9-74eb-44c9-896e-28f36daa424c None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:27.109852 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052ab9-74eb-44c9-896e-28f36daa424c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:27.110135 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052ab9-74eb-44c9-896e-28f36daa424c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:27.184497 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f052ab9-74eb-44c9-896e-28f36daa424c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:27.185998 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f052ab9-74eb-44c9-896e-28f36daa424c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:27.248230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:27.292796 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 157/316] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:27.298176 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1baca9-3c03-4bd9-a7c9-d35ec46b4585 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:27.421897 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1baca9-3c03-4bd9-a7c9-d35ec46b4585 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:27.458918 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3391ea9-0199-43ea-be07-bfa69f68b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:27.459787 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3391ea9-0199-43ea-be07-bfa69f68b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:27.460074 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3391ea9-0199-43ea-be07-bfa69f68b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:27.460420 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3391ea9-0199-43ea-be07-bfa69f68b7e5 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:27.461735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3391ea9-0199-43ea-be07-bfa69f68b7e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:27.463229 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3391ea9-0199-43ea-be07-bfa69f68b7e5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:27.465231 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 160/317] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:27 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:27.470919 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f052ab9-74eb-44c9-896e-28f36daa424c None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:27.574405 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f052ab9-74eb-44c9-896e-28f36daa424c None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:27.608998 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b964a8-477b-4189-aa07-a9e3b5a0420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:27.609662 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b964a8-477b-4189-aa07-a9e3b5a0420a None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:27.609949 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b964a8-477b-4189-aa07-a9e3b5a0420a None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:27.610230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b964a8-477b-4189-aa07-a9e3b5a0420a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:27.611090 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b964a8-477b-4189-aa07-a9e3b5a0420a None admin] RBAC: Adding query filter params (role.id=c10458d8928f42bdb48358e0b4ca344e, scope.project.id=d5ac856d373a44118058b6acc934e6e4, user.id=55fc4dfc1a1a438faf88edec7acac37f) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:27.611405 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b964a8-477b-4189-aa07-a9e3b5a0420a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:27.612838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b964a8-477b-4189-aa07-a9e3b5a0420a None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:27.619672 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 158/318] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:27 2022] GET /identity/v3/role_assignments?user.id=55fc4dfc1a1a438faf88edec7acac37f&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=c10458d8928f42bdb48358e0b4ca344e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:28.431821 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77563f7e-1237-4500-83b4-e4606583cb5f None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:28.432435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77563f7e-1237-4500-83b4-e4606583cb5f None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:28.432435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77563f7e-1237-4500-83b4-e4606583cb5f None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:28.433778 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 161/319] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:28.439115 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9e138-092b-4f3a-83a6-791a7dbfebe5 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:28.439564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9e138-092b-4f3a-83a6-791a7dbfebe5 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:28.439873 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9e138-092b-4f3a-83a6-791a7dbfebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:28.457280 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-dfe9e138-092b-4f3a-83a6-791a7dbfebe5 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:28.458695 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-dfe9e138-092b-4f3a-83a6-791a7dbfebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:28.480982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:28.531954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 159/320] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:28.557095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77563f7e-1237-4500-83b4-e4606583cb5f None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:28.571061 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbf281-d590-4945-9497-3c676e0b8ce4 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:28.571418 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbf281-d590-4945-9497-3c676e0b8ce4 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:28.571711 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbf281-d590-4945-9497-3c676e0b8ce4 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:28.573208 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 160/321] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:28.578051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb2c3c-ca80-40ed-809b-83c4f06f01b7 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:28.578356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb2c3c-ca80-40ed-809b-83c4f06f01b7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:28.578666 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb2c3c-ca80-40ed-809b-83c4f06f01b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:28.593642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:28.595433 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-35bb2c3c-ca80-40ed-809b-83c4f06f01b7 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:28.596630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-35bb2c3c-ca80-40ed-809b-83c4f06f01b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:28.667077 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 161/322] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:28.668504 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77563f7e-1237-4500-83b4-e4606583cb5f None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:28.690180 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb2c3c-ca80-40ed-809b-83c4f06f01b7 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:28.701994 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6c127-9237-4ee1-9271-fb72feedbe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:28.702829 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6c127-9237-4ee1-9271-fb72feedbe87 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:28.703115 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6c127-9237-4ee1-9271-fb72feedbe87 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:28.703394 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6c127-9237-4ee1-9271-fb72feedbe87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:28.714292 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6c127-9237-4ee1-9271-fb72feedbe87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-ebf6c127-9237-4ee1-9271-fb72feedbe87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:28.722005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:28.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:28.724146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:28.728405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 162/323] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:28.729726 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b555e9-0ed2-4819-a7c7-4351c284da9d None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:28.730017 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b555e9-0ed2-4819-a7c7-4351c284da9d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:28.730297 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b555e9-0ed2-4819-a7c7-4351c284da9d None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:28.731607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 163/324] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:28.732295 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b555e9-0ed2-4819-a7c7-4351c284da9d None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:28.781137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:28.796706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb2c3c-ca80-40ed-809b-83c4f06f01b7 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:28.827363 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:28.829969 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4ddeb-000b-47ac-b806-35ddecf840ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:28.830798 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4ddeb-000b-47ac-b806-35ddecf840ba None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:28.831087 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4ddeb-000b-47ac-b806-35ddecf840ba None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:28.831364 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4ddeb-000b-47ac-b806-35ddecf840ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:28.834818 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b555e9-0ed2-4819-a7c7-4351c284da9d None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:28.841881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4ddeb-000b-47ac-b806-35ddecf840ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-fcc4ddeb-000b-47ac-b806-35ddecf840ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:28.849533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:28.850438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:28.851230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 162/325] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:28.851943 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f1d98-7b57-47c9-aed2-81cbf696cc65 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:28.852232 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f1d98-7b57-47c9-aed2-81cbf696cc65 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:28.853067 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f1d98-7b57-47c9-aed2-81cbf696cc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:28.868808 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-6f8f1d98-7b57-47c9-aed2-81cbf696cc65 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:28.870033 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-6f8f1d98-7b57-47c9-aed2-81cbf696cc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:28.873435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b267a48-07ba-4a0c-848b-bdd6e9f0a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:28.874103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b267a48-07ba-4a0c-848b-bdd6e9f0a86a None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:28.874420 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b267a48-07ba-4a0c-848b-bdd6e9f0a86a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:28.874705 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b267a48-07ba-4a0c-848b-bdd6e9f0a86a None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:28.875457 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b267a48-07ba-4a0c-848b-bdd6e9f0a86a None admin] RBAC: Adding query filter params (name=member) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:28.875768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b267a48-07ba-4a0c-848b-bdd6e9f0a86a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:28.877702 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b267a48-07ba-4a0c-848b-bdd6e9f0a86a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:28.885466 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 164/326] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:28.885466 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b267a48-07ba-4a0c-848b-bdd6e9f0a86a None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:28.943740 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 163/327] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:28.943740 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f1d98-7b57-47c9-aed2-81cbf696cc65 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:28.993157 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b267a48-07ba-4a0c-848b-bdd6e9f0a86a None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:29.026664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:29.029074 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590b3a-6a68-4f5b-8220-bcdc51ceb620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:29.029744 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590b3a-6a68-4f5b-8220-bcdc51ceb620 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:29.030031 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590b3a-6a68-4f5b-8220-bcdc51ceb620 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:29.030314 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590b3a-6a68-4f5b-8220-bcdc51ceb620 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:29.031095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590b3a-6a68-4f5b-8220-bcdc51ceb620 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:29.031407 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590b3a-6a68-4f5b-8220-bcdc51ceb620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:29.032797 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590b3a-6a68-4f5b-8220-bcdc51ceb620 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:29.040811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 165/328] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:29.041598 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590b3a-6a68-4f5b-8220-bcdc51ceb620 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:29.049827 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f1d98-7b57-47c9-aed2-81cbf696cc65 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:29.061896 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:29.083897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cb82a-8151-4c0e-a1d6-878f09bc7441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:29.084764 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cb82a-8151-4c0e-a1d6-878f09bc7441 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:29.085047 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cb82a-8151-4c0e-a1d6-878f09bc7441 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:29.085323 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cb82a-8151-4c0e-a1d6-878f09bc7441 None admin] PATH_INFO: `/v3/users/23ec3537b6a54bd9ad6d0ccff7d60495` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:29.086530 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cb82a-8151-4c0e-a1d6-878f09bc7441 None admin] RBAC: Authorizing `identity:get_user(user_id=23ec3537b6a54bd9ad6d0ccff7d60495)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:29.088564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cb82a-8151-4c0e-a1d6-878f09bc7441 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:29.090170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 164/329] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:28 2022] GET /identity/v3/users/23ec3537b6a54bd9ad6d0ccff7d60495 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:29.090945 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cb82a-8151-4c0e-a1d6-878f09bc7441 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:29.148291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590b3a-6a68-4f5b-8220-bcdc51ceb620 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:29.181401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18037531-89e0-4a09-80f5-a0f288ca9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:29.182191 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18037531-89e0-4a09-80f5-a0f288ca9148 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:29.182516 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18037531-89e0-4a09-80f5-a0f288ca9148 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:29.182802 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18037531-89e0-4a09-80f5-a0f288ca9148 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:29.183983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18037531-89e0-4a09-80f5-a0f288ca9148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:29.185435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18037531-89e0-4a09-80f5-a0f288ca9148 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:29.187086 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 166/330] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:29.187529 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cb82a-8151-4c0e-a1d6-878f09bc7441 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:29.187922 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18037531-89e0-4a09-80f5-a0f288ca9148 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:29.225611 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9304614-de0f-49f3-8710-a953aa09c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:29.226435 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9304614-de0f-49f3-8710-a953aa09c937 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:29.226726 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9304614-de0f-49f3-8710-a953aa09c937 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:29.227007 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9304614-de0f-49f3-8710-a953aa09c937 None admin] PATH_INFO: `/v3/users/80572a011fc84842a4dc9f3d68f93f29` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:29.228259 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9304614-de0f-49f3-8710-a953aa09c937 None admin] RBAC: Authorizing `identity:get_user(user_id=80572a011fc84842a4dc9f3d68f93f29)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:29.229703 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9304614-de0f-49f3-8710-a953aa09c937 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:29.231367 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 165/331] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:29 2022] GET /identity/v3/users/80572a011fc84842a4dc9f3d68f93f29 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:29.232106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9304614-de0f-49f3-8710-a953aa09c937 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:29.247327 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:29.278589 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:29.293084 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18037531-89e0-4a09-80f5-a0f288ca9148 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:29.332386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f31200-3682-4826-b923-867daea0ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:29.333046 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f31200-3682-4826-b923-867daea0ff77 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:29.333326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f31200-3682-4826-b923-867daea0ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:29.333605 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f31200-3682-4826-b923-867daea0ff77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:29.334465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f31200-3682-4826-b923-867daea0ff77 None admin] RBAC: Adding query filter params (role.id=030683e4ff8d4d1587d99164f75c0fb8, user.id=23ec3537b6a54bd9ad6d0ccff7d60495, scope.system=all) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:29.334780 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f31200-3682-4826-b923-867daea0ff77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:29.336247 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f31200-3682-4826-b923-867daea0ff77 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:29.341502 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9304614-de0f-49f3-8710-a953aa09c937 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:29.348193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 167/332] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Jun 6 06:56:29 2022] GET /identity/v3/role_assignments?user.id=23ec3537b6a54bd9ad6d0ccff7d60495&scope.system=all&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:29.348974 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f31200-3682-4826-b923-867daea0ff77 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:29.391326 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ed68b-6e72-4d64-9b58-317c6feee2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:29.392017 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ed68b-6e72-4d64-9b58-317c6feee2e5 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:29.392304 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ed68b-6e72-4d64-9b58-317c6feee2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:29.392582 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ed68b-6e72-4d64-9b58-317c6feee2e5 None admin] PATH_INFO: `/v3/groups` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:29.393292 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ed68b-6e72-4d64-9b58-317c6feee2e5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:29.395432 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ed68b-6e72-4d64-9b58-317c6feee2e5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:29.458074 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f31200-3682-4826-b923-867daea0ff77 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:29.486781 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 166/333] 10.222.0.42 () {60 vars in 1134 bytes} [Mon Jun 6 06:56:29 2022] POST /identity/v3/groups => generated 226 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:29.506669 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760308c7-45f3-406d-964a-c49865c40bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:29.507724 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760308c7-45f3-406d-964a-c49865c40bfa None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:29.508014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760308c7-45f3-406d-964a-c49865c40bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:29.508304 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760308c7-45f3-406d-964a-c49865c40bfa None admin] PATH_INFO: `/v3/system/users/80572a011fc84842a4dc9f3d68f93f29/roles/c10458d8928f42bdb48358e0b4ca344e` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:29.510738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760308c7-45f3-406d-964a-c49865c40bfa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=80572a011fc84842a4dc9f3d68f93f29, role_id=c10458d8928f42bdb48358e0b4ca344e)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:29.512227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760308c7-45f3-406d-964a-c49865c40bfa None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:29.573741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 168/334] 10.222.0.42 () {58 vars in 1334 bytes} [Mon Jun 6 06:56:29 2022] PUT /identity/v3/system/users/80572a011fc84842a4dc9f3d68f93f29/roles/c10458d8928f42bdb48358e0b4ca344e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:32.073618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9957a1-b602-464f-bc42-e983fa81e1c0 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:32.074151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9957a1-b602-464f-bc42-e983fa81e1c0 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:32.074229 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9957a1-b602-464f-bc42-e983fa81e1c0 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:32.075865 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 167/335] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:32.080852 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237f836-e66c-4776-ae91-9949918f1504 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:32.081264 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237f836-e66c-4776-ae91-9949918f1504 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:32.081440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237f836-e66c-4776-ae91-9949918f1504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:32.107366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-a237f836-e66c-4776-ae91-9949918f1504 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:32.108570 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-a237f836-e66c-4776-ae91-9949918f1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:32.110758 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:32.202359 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 169/336] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:32.235358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9957a1-b602-464f-bc42-e983fa81e1c0 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:32.316249 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:32.355276 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9957a1-b602-464f-bc42-e983fa81e1c0 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:32.392476 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36792a79-4b07-4050-9593-195316249345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:32.393284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36792a79-4b07-4050-9593-195316249345 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:32.393572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36792a79-4b07-4050-9593-195316249345 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:32.393853 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36792a79-4b07-4050-9593-195316249345 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:32.407935 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36792a79-4b07-4050-9593-195316249345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-36792a79-4b07-4050-9593-195316249345 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:32.415731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:32.416633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:32.418026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 168/337] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:32.423344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237f836-e66c-4776-ae91-9949918f1504 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:32.532238 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237f836-e66c-4776-ae91-9949918f1504 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:32.567842 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39312d-e3b2-4ead-a3ff-c3e84b454aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:32.568515 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39312d-e3b2-4ead-a3ff-c3e84b454aca None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:32.568800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39312d-e3b2-4ead-a3ff-c3e84b454aca None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:32.569080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39312d-e3b2-4ead-a3ff-c3e84b454aca None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:32.569831 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39312d-e3b2-4ead-a3ff-c3e84b454aca None admin] RBAC: Adding query filter params (name=member) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:32.570140 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39312d-e3b2-4ead-a3ff-c3e84b454aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:32.572188 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39312d-e3b2-4ead-a3ff-c3e84b454aca None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:32.577432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:32.581072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 170/338] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:32.586358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36792a79-4b07-4050-9593-195316249345 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:32.693570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36792a79-4b07-4050-9593-195316249345 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:32.731283 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:32.736379 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34569ab1-e343-4648-968f-3c56f31db6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:32.737035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569ab1-e343-4648-968f-3c56f31db6a9 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:32.737325 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569ab1-e343-4648-968f-3c56f31db6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:32.737604 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34569ab1-e343-4648-968f-3c56f31db6a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:32.819800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34569ab1-e343-4648-968f-3c56f31db6a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:32.821303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34569ab1-e343-4648-968f-3c56f31db6a9 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:32.843556 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096d5a2-ea3f-4e0a-adbb-94024a440b22 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:32.846525 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096d5a2-ea3f-4e0a-adbb-94024a440b22 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:32.846525 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096d5a2-ea3f-4e0a-adbb-94024a440b22 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:32.846525 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 171/339] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:32.852122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112e34-2143-476b-b05e-95cf3e5e4cc3 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:32.853291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112e34-2143-476b-b05e-95cf3e5e4cc3 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:32.853787 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112e34-2143-476b-b05e-95cf3e5e4cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:32.878524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-56112e34-2143-476b-b05e-95cf3e5e4cc3 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:32.880075 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-56112e34-2143-476b-b05e-95cf3e5e4cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:32.967035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 169/340] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:32.969778 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7044b6-a95e-4117-9eab-641ed9527d36 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:32.974636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7044b6-a95e-4117-9eab-641ed9527d36 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:32.974636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7044b6-a95e-4117-9eab-641ed9527d36 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:32.974636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 170/341] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:32.982261 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7044b6-a95e-4117-9eab-641ed9527d36 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:33.001103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 172/342] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:33.002755 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc905c32-dc2b-4942-a0f8-548f438a4288 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:33.003045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc905c32-dc2b-4942-a0f8-548f438a4288 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:33.003326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc905c32-dc2b-4942-a0f8-548f438a4288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:33.049130 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-bc905c32-dc2b-4942-a0f8-548f438a4288 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:33.050319 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-bc905c32-dc2b-4942-a0f8-548f438a4288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:33.056940 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:33.189402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 173/343] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:33.194951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc905c32-dc2b-4942-a0f8-548f438a4288 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:33.208344 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7044b6-a95e-4117-9eab-641ed9527d36 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:33.285923 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe23506-59be-4280-a8b4-30c0dbbb9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:33.287037 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe23506-59be-4280-a8b4-30c0dbbb9e80 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:33.287322 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe23506-59be-4280-a8b4-30c0dbbb9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:33.287598 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe23506-59be-4280-a8b4-30c0dbbb9e80 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:33.289524 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe23506-59be-4280-a8b4-30c0dbbb9e80 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:33.291578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe23506-59be-4280-a8b4-30c0dbbb9e80 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:33.296311 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 171/344] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:32 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:33.297093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe23506-59be-4280-a8b4-30c0dbbb9e80 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:33.320780 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:33.417356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc905c32-dc2b-4942-a0f8-548f438a4288 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:33.455803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:33.459337 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe23506-59be-4280-a8b4-30c0dbbb9e80 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:33.465874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a20264-3996-4431-b0e7-af659db1f3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:33.468171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a20264-3996-4431-b0e7-af659db1f3a8 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:33.468171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a20264-3996-4431-b0e7-af659db1f3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:33.468171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a20264-3996-4431-b0e7-af659db1f3a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:33.482062 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a20264-3996-4431-b0e7-af659db1f3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-b1a20264-3996-4431-b0e7-af659db1f3a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:33.493663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:33.498875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:33.499699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:33.500762 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 174/345] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:33.501671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a20264-3996-4431-b0e7-af659db1f3a8 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:33.502997 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c849118-9c48-4972-aa8c-7cbe197a57a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:33.503968 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c849118-9c48-4972-aa8c-7cbe197a57a4 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:33.504262 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c849118-9c48-4972-aa8c-7cbe197a57a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:33.504611 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c849118-9c48-4972-aa8c-7cbe197a57a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:33.517877 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c849118-9c48-4972-aa8c-7cbe197a57a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-8c849118-9c48-4972-aa8c-7cbe197a57a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:33.528023 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:33.530128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 172/346] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:33.532144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9de750-34aa-4115-87c9-5b1f717e53dc None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:33.533838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9de750-34aa-4115-87c9-5b1f717e53dc None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:33.533838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9de750-34aa-4115-87c9-5b1f717e53dc None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:33.533838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 173/347] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:33.533838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9de750-34aa-4115-87c9-5b1f717e53dc None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:33.637945 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a20264-3996-4431-b0e7-af659db1f3a8 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:33.665845 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:33.685451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d5850-f678-43b8-87a8-267086429736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:33.686359 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d5850-f678-43b8-87a8-267086429736 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:33.686756 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d5850-f678-43b8-87a8-267086429736 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:33.687148 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d5850-f678-43b8-87a8-267086429736 None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:33.688122 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9de750-34aa-4115-87c9-5b1f717e53dc None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:33.694825 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d5850-f678-43b8-87a8-267086429736 None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:33.697534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d5850-f678-43b8-87a8-267086429736 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:33.699948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 175/348] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:33 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:33.701121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d5850-f678-43b8-87a8-267086429736 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:33.732135 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc06a-ddaa-426d-a0ab-e41333f3cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:33.732739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc06a-ddaa-426d-a0ab-e41333f3cb92 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:33.733074 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc06a-ddaa-426d-a0ab-e41333f3cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:33.733358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc06a-ddaa-426d-a0ab-e41333f3cb92 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:33.734119 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fc06a-ddaa-426d-a0ab-e41333f3cb92 None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:33.734934 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fc06a-ddaa-426d-a0ab-e41333f3cb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:33.736538 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fc06a-ddaa-426d-a0ab-e41333f3cb92 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:33.750744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 174/349] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:33.752379 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1172b2-d8f0-49e6-87cd-69d280ba42bd None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:33.752674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1172b2-d8f0-49e6-87cd-69d280ba42bd None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:33.754293 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1172b2-d8f0-49e6-87cd-69d280ba42bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:33.776314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-2d1172b2-d8f0-49e6-87cd-69d280ba42bd None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:33.777562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-2d1172b2-d8f0-49e6-87cd-69d280ba42bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:33.798697 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:33.842712 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d5850-f678-43b8-87a8-267086429736 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:33.872950 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 175/350] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:33.874310 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1172b2-d8f0-49e6-87cd-69d280ba42bd None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:33.883011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79395201-df1a-4781-af59-8f36b5037601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:33.884252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395201-df1a-4781-af59-8f36b5037601 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:33.884543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395201-df1a-4781-af59-8f36b5037601 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:33.884820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395201-df1a-4781-af59-8f36b5037601 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:33.885821 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79395201-df1a-4781-af59-8f36b5037601 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:33.885930 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79395201-df1a-4781-af59-8f36b5037601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:33.887294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79395201-df1a-4781-af59-8f36b5037601 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:33.896230 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 176/351] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:33.897190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79395201-df1a-4781-af59-8f36b5037601 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:33.959673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:33.996497 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1172b2-d8f0-49e6-87cd-69d280ba42bd None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:34.023965 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79395201-df1a-4781-af59-8f36b5037601 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:34.038725 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6759d0-3f2c-40f8-aa35-f0508c328a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:34.039798 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6759d0-3f2c-40f8-aa35-f0508c328a6d None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.040365 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6759d0-3f2c-40f8-aa35-f0508c328a6d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.040882 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6759d0-3f2c-40f8-aa35-f0508c328a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.041953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6759d0-3f2c-40f8-aa35-f0508c328a6d None admin] RBAC: Adding query filter params (group.id=0ed4730d02d74b6192703e26b4adafb4, role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:34.042630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6759d0-3f2c-40f8-aa35-f0508c328a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:34.044415 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6759d0-3f2c-40f8-aa35-f0508c328a6d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:34.051531 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 176/352] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:33 2022] GET /identity/v3/role_assignments?group.id=0ed4730d02d74b6192703e26b4adafb4&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:34.052795 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6759d0-3f2c-40f8-aa35-f0508c328a6d None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:34.062752 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118562b-ccf7-4bee-b34a-3965184105a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:34.063424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118562b-ccf7-4bee-b34a-3965184105a5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.063711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118562b-ccf7-4bee-b34a-3965184105a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.063992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118562b-ccf7-4bee-b34a-3965184105a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.077531 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:34.142145 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118562b-ccf7-4bee-b34a-3965184105a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:34.144368 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118562b-ccf7-4bee-b34a-3965184105a5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:34.179794 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6759d0-3f2c-40f8-aa35-f0508c328a6d None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:34.195509 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:34.224440 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0cdb-aee3-4a46-9264-4f7e274eb5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:34.226038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0cdb-aee3-4a46-9264-4f7e274eb5c7 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.226570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0cdb-aee3-4a46-9264-4f7e274eb5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.227073 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0cdb-aee3-4a46-9264-4f7e274eb5c7 None admin] PATH_INFO: `/v3/users/80572a011fc84842a4dc9f3d68f93f29` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.228788 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc0cdb-aee3-4a46-9264-4f7e274eb5c7 None admin] RBAC: Authorizing `identity:get_user(user_id=80572a011fc84842a4dc9f3d68f93f29)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:34.230672 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc0cdb-aee3-4a46-9264-4f7e274eb5c7 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:34.232716 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 177/353] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Jun 6 06:56:34 2022] GET /identity/v3/users/80572a011fc84842a4dc9f3d68f93f29 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:34.233924 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0cdb-aee3-4a46-9264-4f7e274eb5c7 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:34.259325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 177/354] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:34.260670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70932347-3688-4d5b-a27c-46d498703f4e None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.260962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70932347-3688-4d5b-a27c-46d498703f4e None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.261244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70932347-3688-4d5b-a27c-46d498703f4e None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.268559 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 178/355] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:34.269273 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70932347-3688-4d5b-a27c-46d498703f4e None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:34.338424 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:34.357622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0cdb-aee3-4a46-9264-4f7e274eb5c7 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:34.390055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70932347-3688-4d5b-a27c-46d498703f4e None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:34.399560 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698cbf-8cbc-4d63-992e-9f4699dde739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:34.399932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698cbf-8cbc-4d63-992e-9f4699dde739 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.400214 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698cbf-8cbc-4d63-992e-9f4699dde739 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.400488 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698cbf-8cbc-4d63-992e-9f4699dde739 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.413206 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae698cbf-8cbc-4d63-992e-9f4699dde739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-ae698cbf-8cbc-4d63-992e-9f4699dde739 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:34.421959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:34.422933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 178/356] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:34.424254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698cbf-8cbc-4d63-992e-9f4699dde739 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:34.448427 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e38770-534f-46f3-b267-dd6d7fe9cfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:34.449098 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e38770-534f-46f3-b267-dd6d7fe9cfad None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.449388 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e38770-534f-46f3-b267-dd6d7fe9cfad None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.449665 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e38770-534f-46f3-b267-dd6d7fe9cfad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.450544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e38770-534f-46f3-b267-dd6d7fe9cfad None admin] RBAC: Adding query filter params (role.id=c10458d8928f42bdb48358e0b4ca344e, user.id=80572a011fc84842a4dc9f3d68f93f29, scope.system=all) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:34.450863 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e38770-534f-46f3-b267-dd6d7fe9cfad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:34.452958 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e38770-534f-46f3-b267-dd6d7fe9cfad None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:34.467624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 179/357] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Jun 6 06:56:34 2022] GET /identity/v3/role_assignments?user.id=80572a011fc84842a4dc9f3d68f93f29&scope.system=all&role.id=c10458d8928f42bdb48358e0b4ca344e => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:34.469211 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d88ed-2a1b-479c-8a1c-31713fba089c None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.469710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d88ed-2a1b-479c-8a1c-31713fba089c None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.470173 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d88ed-2a1b-479c-8a1c-31713fba089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.476976 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:34.488663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-b84d88ed-2a1b-479c-8a1c-31713fba089c None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:34.490216 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-b84d88ed-2a1b-479c-8a1c-31713fba089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:34.568861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698cbf-8cbc-4d63-992e-9f4699dde739 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:34.574755 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 180/358] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:34.576622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53ff8-4348-4d9b-a180-0f75328578f1 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.577111 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53ff8-4348-4d9b-a180-0f75328578f1 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.577637 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53ff8-4348-4d9b-a180-0f75328578f1 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.579302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 181/359] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:34.584532 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca53ff8-4348-4d9b-a180-0f75328578f1 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:34.627174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7d9d1-e52f-4c7c-bd86-80272a65f5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:34.628140 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7d9d1-e52f-4c7c-bd86-80272a65f5c2 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.628594 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7d9d1-e52f-4c7c-bd86-80272a65f5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.629019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7d9d1-e52f-4c7c-bd86-80272a65f5c2 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.630729 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7d9d1-e52f-4c7c-bd86-80272a65f5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:34.633293 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7d9d1-e52f-4c7c-bd86-80272a65f5c2 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:34.635375 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 179/360] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:34 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:34.637088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dfe82-a08e-46a9-af5e-fe9bfdbddc4b None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.637421 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dfe82-a08e-46a9-af5e-fe9bfdbddc4b None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.637749 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dfe82-a08e-46a9-af5e-fe9bfdbddc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.661070 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-379dfe82-a08e-46a9-af5e-fe9bfdbddc4b None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:34.662317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-379dfe82-a08e-46a9-af5e-fe9bfdbddc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:34.674578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:34.725496 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca53ff8-4348-4d9b-a180-0f75328578f1 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:34.759983 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 180/361] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:34.760859 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dfe82-a08e-46a9-af5e-fe9bfdbddc4b None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:34.768635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860bb2-b0da-47a7-b478-064ac1fb1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:34.769316 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860bb2-b0da-47a7-b478-064ac1fb1fa4 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.769726 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860bb2-b0da-47a7-b478-064ac1fb1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.770011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860bb2-b0da-47a7-b478-064ac1fb1fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.770811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860bb2-b0da-47a7-b478-064ac1fb1fa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:34.771123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860bb2-b0da-47a7-b478-064ac1fb1fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:34.772666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860bb2-b0da-47a7-b478-064ac1fb1fa4 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:34.775611 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:34.785336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 182/362] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:34.789911 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860bb2-b0da-47a7-b478-064ac1fb1fa4 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:34.887821 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dfe82-a08e-46a9-af5e-fe9bfdbddc4b None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:34.916099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860bb2-b0da-47a7-b478-064ac1fb1fa4 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:34.935032 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21e3c1-2fc8-4ed2-b349-994939902d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:34.935868 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21e3c1-2fc8-4ed2-b349-994939902d94 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.936202 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21e3c1-2fc8-4ed2-b349-994939902d94 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.936465 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21e3c1-2fc8-4ed2-b349-994939902d94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.950474 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21e3c1-2fc8-4ed2-b349-994939902d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-ac21e3c1-2fc8-4ed2-b349-994939902d94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:34.959410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:34.960351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:34.961174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:34.963874 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 181/363] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:34.964837 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21e3c1-2fc8-4ed2-b349-994939902d94 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:34.967548 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:34.968538 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba762a3-1f1a-41cf-826f-a1ea97559bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:34.970121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba762a3-1f1a-41cf-826f-a1ea97559bda None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:34.970121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba762a3-1f1a-41cf-826f-a1ea97559bda None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:34.970121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba762a3-1f1a-41cf-826f-a1ea97559bda None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:34.971264 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba762a3-1f1a-41cf-826f-a1ea97559bda None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:34.972721 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba762a3-1f1a-41cf-826f-a1ea97559bda None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:34.980318 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 183/364] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:34 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:34.980318 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba762a3-1f1a-41cf-826f-a1ea97559bda None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:35.048974 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:35.103474 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21e3c1-2fc8-4ed2-b349-994939902d94 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:35.103808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba762a3-1f1a-41cf-826f-a1ea97559bda None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:35.145344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b60f3-50c3-4d2c-8018-4ea0408d894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:35.146082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b60f3-50c3-4d2c-8018-4ea0408d894b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:35.146387 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b60f3-50c3-4d2c-8018-4ea0408d894b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:35.146674 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b60f3-50c3-4d2c-8018-4ea0408d894b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:35.147305 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ff15a-d84c-4fd5-89da-f95ada9250ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:35.148085 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ff15a-d84c-4fd5-89da-f95ada9250ff None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:35.148441 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ff15a-d84c-4fd5-89da-f95ada9250ff None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:35.148790 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ff15a-d84c-4fd5-89da-f95ada9250ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:35.160661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b60f3-50c3-4d2c-8018-4ea0408d894b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-108b60f3-50c3-4d2c-8018-4ea0408d894b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:35.169221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:35.170219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:35.171032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 184/365] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:35.171677 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b60f3-50c3-4d2c-8018-4ea0408d894b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:35.246207 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ff15a-d84c-4fd5-89da-f95ada9250ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:35.247867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ff15a-d84c-4fd5-89da-f95ada9250ff None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:35.249838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:35.305601 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b60f3-50c3-4d2c-8018-4ea0408d894b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:35.339034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:35.351462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c1237-a500-4a54-aacb-16f51fa872b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:35.352629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c1237-a500-4a54-aacb-16f51fa872b8 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:35.353114 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c1237-a500-4a54-aacb-16f51fa872b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:35.353553 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c1237-a500-4a54-aacb-16f51fa872b8 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:35.356805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c1237-a500-4a54-aacb-16f51fa872b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:35.356805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c1237-a500-4a54-aacb-16f51fa872b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:35.356979 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c1237-a500-4a54-aacb-16f51fa872b8 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:35.370175 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 185/366] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:35.370175 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c1237-a500-4a54-aacb-16f51fa872b8 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:35.405573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 182/367] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:35.406770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ff15a-d84c-4fd5-89da-f95ada9250ff None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:35.508210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c1237-a500-4a54-aacb-16f51fa872b8 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:35.557444 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ff15a-d84c-4fd5-89da-f95ada9250ff None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:35.557973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098152-e6ff-4dba-a695-287d1dea9450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:35.560052 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098152-e6ff-4dba-a695-287d1dea9450 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:35.560052 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098152-e6ff-4dba-a695-287d1dea9450 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:35.560052 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098152-e6ff-4dba-a695-287d1dea9450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:35.560052 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098152-e6ff-4dba-a695-287d1dea9450 None admin] RBAC: Adding query filter params (group.id=0ed4730d02d74b6192703e26b4adafb4, role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=d5ac856d373a44118058b6acc934e6e4) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:35.560347 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098152-e6ff-4dba-a695-287d1dea9450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:35.561392 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:35.561756 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098152-e6ff-4dba-a695-287d1dea9450 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:35.567963 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 186/368] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:35 2022] GET /identity/v3/role_assignments?group.id=0ed4730d02d74b6192703e26b4adafb4&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:35.568567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098152-e6ff-4dba-a695-287d1dea9450 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:35.600551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c8008-f471-43c3-af22-5f22d323ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:35.601243 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c8008-f471-43c3-af22-5f22d323ae77 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:35.601534 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c8008-f471-43c3-af22-5f22d323ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:35.601814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c8008-f471-43c3-af22-5f22d323ae77 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:35.602685 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c8008-f471-43c3-af22-5f22d323ae77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:35.603000 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c8008-f471-43c3-af22-5f22d323ae77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:35.604551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c8008-f471-43c3-af22-5f22d323ae77 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:35.615330 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 183/369] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:35.616208 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c8008-f471-43c3-af22-5f22d323ae77 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:35.642321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:35.703078 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098152-e6ff-4dba-a695-287d1dea9450 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:35.744184 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f518e-75f2-44ba-86c2-a1803a215eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:35.744860 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f518e-75f2-44ba-86c2-a1803a215eec None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:35.745148 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f518e-75f2-44ba-86c2-a1803a215eec None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:35.745430 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f518e-75f2-44ba-86c2-a1803a215eec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:35.756230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c8008-f471-43c3-af22-5f22d323ae77 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:35.798922 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933447-1bbd-4f3e-9111-b66c80cba793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:35.799866 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933447-1bbd-4f3e-9111-b66c80cba793 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:35.800157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933447-1bbd-4f3e-9111-b66c80cba793 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:35.800445 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933447-1bbd-4f3e-9111-b66c80cba793 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:35.801729 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1933447-1bbd-4f3e-9111-b66c80cba793 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:35.803299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1933447-1bbd-4f3e-9111-b66c80cba793 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:35.806182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 184/370] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:35 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:35.806923 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933447-1bbd-4f3e-9111-b66c80cba793 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:35.825216 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f518e-75f2-44ba-86c2-a1803a215eec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:35.826881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f518e-75f2-44ba-86c2-a1803a215eec None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:35.842412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:35.891069 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:35.925682 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933447-1bbd-4f3e-9111-b66c80cba793 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:35.959640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 187/371] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:35.961064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f518e-75f2-44ba-86c2-a1803a215eec None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:35.975465 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba38740-1194-4ef2-beec-d011c0e34f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:35.976138 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba38740-1194-4ef2-beec-d011c0e34f91 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:35.976429 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba38740-1194-4ef2-beec-d011c0e34f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:35.976714 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba38740-1194-4ef2-beec-d011c0e34f91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.087380 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba38740-1194-4ef2-beec-d011c0e34f91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:36.089480 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba38740-1194-4ef2-beec-d011c0e34f91 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:36.094264 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f518e-75f2-44ba-86c2-a1803a215eec None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:36.129776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:36.136318 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4490e-6332-4917-9c75-8ec26dc8b2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:36.137503 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4490e-6332-4917-9c75-8ec26dc8b2a9 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.137999 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4490e-6332-4917-9c75-8ec26dc8b2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:36.138521 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4490e-6332-4917-9c75-8ec26dc8b2a9 None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.139976 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4490e-6332-4917-9c75-8ec26dc8b2a9 None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:36.141657 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4490e-6332-4917-9c75-8ec26dc8b2a9 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:36.144408 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 188/372] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:35 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:36.145455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4490e-6332-4917-9c75-8ec26dc8b2a9 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:36.166637 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:36.218427 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 185/373] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:36.218717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba38740-1194-4ef2-beec-d011c0e34f91 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:36.269837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4490e-6332-4917-9c75-8ec26dc8b2a9 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:36.317753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f5ea-c3ca-452a-a7e3-180870ac8b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:36.319061 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f5ea-c3ca-452a-a7e3-180870ac8b61 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.319347 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f5ea-c3ca-452a-a7e3-180870ac8b61 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:36.319628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f5ea-c3ca-452a-a7e3-180870ac8b61 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.321883 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f5ea-c3ca-452a-a7e3-180870ac8b61 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:36.323651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f5ea-c3ca-452a-a7e3-180870ac8b61 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:36.326685 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 189/374] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:36 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:36.327559 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f5ea-c3ca-452a-a7e3-180870ac8b61 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:36.350622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba38740-1194-4ef2-beec-d011c0e34f91 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:36.386618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:36.393379 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadfc7e-61c0-4cde-8bff-e715e0872c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:36.397490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadfc7e-61c0-4cde-8bff-e715e0872c37 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.397490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadfc7e-61c0-4cde-8bff-e715e0872c37 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:36.397490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadfc7e-61c0-4cde-8bff-e715e0872c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.397490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadfc7e-61c0-4cde-8bff-e715e0872c37 None admin] RBAC: Adding query filter params (group.id=0ed4730d02d74b6192703e26b4adafb4, role.id=33a7efc2edd44d81bc33bfd6d02c61cb, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:36.397490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadfc7e-61c0-4cde-8bff-e715e0872c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:36.399076 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadfc7e-61c0-4cde-8bff-e715e0872c37 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:36.405989 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 186/375] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:36 2022] GET /identity/v3/role_assignments?group.id=0ed4730d02d74b6192703e26b4adafb4&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=33a7efc2edd44d81bc33bfd6d02c61cb => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:36.407253 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadfc7e-61c0-4cde-8bff-e715e0872c37 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:36.426286 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:36.443231 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f5ea-c3ca-452a-a7e3-180870ac8b61 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:36.482472 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064e80-a34e-4848-a9f3-b6e72cc0b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:36.483270 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064e80-a34e-4848-a9f3-b6e72cc0b988 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.483618 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064e80-a34e-4848-a9f3-b6e72cc0b988 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:36.483891 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064e80-a34e-4848-a9f3-b6e72cc0b988 None admin] PATH_INFO: `/v3/projects/0d774be4b4f647c4aa73f115724f3d96` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.485302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064e80-a34e-4848-a9f3-b6e72cc0b988 None admin] RBAC: Authorizing `identity:get_project(project_id=0d774be4b4f647c4aa73f115724f3d96)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:36.487091 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064e80-a34e-4848-a9f3-b6e72cc0b988 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:36.489246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 190/376] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:36 2022] GET /identity/v3/projects/0d774be4b4f647c4aa73f115724f3d96 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:36.495425 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064e80-a34e-4848-a9f3-b6e72cc0b988 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:36.539155 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadfc7e-61c0-4cde-8bff-e715e0872c37 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:36.585146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd28265-2f71-477e-8de6-645e84d72642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:36.586291 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd28265-2f71-477e-8de6-645e84d72642 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.586707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd28265-2f71-477e-8de6-645e84d72642 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:36.587028 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd28265-2f71-477e-8de6-645e84d72642 None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.588313 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd28265-2f71-477e-8de6-645e84d72642 None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:36.590058 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd28265-2f71-477e-8de6-645e84d72642 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:36.592272 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 187/377] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:36 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:36.597785 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd28265-2f71-477e-8de6-645e84d72642 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:36.645110 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064e80-a34e-4848-a9f3-b6e72cc0b988 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:36.677445 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:36.702728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02a80f-9ee3-4dd4-8644-0d54015a335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:36.704462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a80f-9ee3-4dd4-8644-0d54015a335d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.704905 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a80f-9ee3-4dd4-8644-0d54015a335d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:36.705638 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a80f-9ee3-4dd4-8644-0d54015a335d None admin] PATH_INFO: `/v3/groups/801a518589a7483396fdbdb796da45f6` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.714601 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02a80f-9ee3-4dd4-8644-0d54015a335d None admin] RBAC: Authorizing `identity:get_group(group_id=801a518589a7483396fdbdb796da45f6)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:36.719024 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02a80f-9ee3-4dd4-8644-0d54015a335d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:36.722512 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 191/378] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:36 2022] GET /identity/v3/groups/801a518589a7483396fdbdb796da45f6 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:36.728938 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02a80f-9ee3-4dd4-8644-0d54015a335d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:36.736385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd28265-2f71-477e-8de6-645e84d72642 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:36.764315 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:36.788811 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef97ee7-9ce3-47d6-982e-da9254640280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:36.789487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef97ee7-9ce3-47d6-982e-da9254640280 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.790314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef97ee7-9ce3-47d6-982e-da9254640280 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:36.790663 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef97ee7-9ce3-47d6-982e-da9254640280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.791507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef97ee7-9ce3-47d6-982e-da9254640280 None admin] RBAC: Adding query filter params (group.id=0ed4730d02d74b6192703e26b4adafb4, role.id=33a7efc2edd44d81bc33bfd6d02c61cb, scope.project.id=d5ac856d373a44118058b6acc934e6e4) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:36.791827 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef97ee7-9ce3-47d6-982e-da9254640280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:36.793283 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef97ee7-9ce3-47d6-982e-da9254640280 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:36.804081 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 188/379] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:36 2022] GET /identity/v3/role_assignments?group.id=0ed4730d02d74b6192703e26b4adafb4&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=33a7efc2edd44d81bc33bfd6d02c61cb => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:36.863389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba826e1-bb05-4eab-8684-836984824087 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.863683 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba826e1-bb05-4eab-8684-836984824087 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:36.863991 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba826e1-bb05-4eab-8684-836984824087 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.866548 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 189/380] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:36.876750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f320d74-a5ed-48c0-abcf-5357380837f2 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.877306 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f320d74-a5ed-48c0-abcf-5357380837f2 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:36.877591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f320d74-a5ed-48c0-abcf-5357380837f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:36.903843 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-2f320d74-a5ed-48c0-abcf-5357380837f2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:36.905233 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-2f320d74-a5ed-48c0-abcf-5357380837f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:36.909675 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02a80f-9ee3-4dd4-8644-0d54015a335d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:36.998429 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd995b-7156-4a90-9bb1-1ca9b8386e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:36.999374 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd995b-7156-4a90-9bb1-1ca9b8386e0c None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:36.999805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd995b-7156-4a90-9bb1-1ca9b8386e0c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:37.000236 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd995b-7156-4a90-9bb1-1ca9b8386e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:37.001251 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd995b-7156-4a90-9bb1-1ca9b8386e0c None admin] RBAC: Adding query filter params (group.id=801a518589a7483396fdbdb796da45f6, role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=0d774be4b4f647c4aa73f115724f3d96) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:37.001728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd995b-7156-4a90-9bb1-1ca9b8386e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:37.003660 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd995b-7156-4a90-9bb1-1ca9b8386e0c None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:37.020303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 192/381] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:36 2022] GET /identity/v3/role_assignments?group.id=801a518589a7483396fdbdb796da45f6&scope.project.id=0d774be4b4f647c4aa73f115724f3d96&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 260 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:37.052707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 190/382] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:37.083857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd995b-7156-4a90-9bb1-1ca9b8386e0c None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:37.221720 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:37.240924 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd995b-7156-4a90-9bb1-1ca9b8386e0c None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:37.280989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eda34f-ef12-41e8-b191-674ab0c2f0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:37.281746 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eda34f-ef12-41e8-b191-674ab0c2f0db None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:37.282032 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eda34f-ef12-41e8-b191-674ab0c2f0db None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:37.282311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eda34f-ef12-41e8-b191-674ab0c2f0db None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:37.296932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eda34f-ef12-41e8-b191-674ab0c2f0db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-25eda34f-ef12-41e8-b191-674ab0c2f0db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:37.304822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:37.306051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:37.307442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 193/383] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:37.312331 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f320d74-a5ed-48c0-abcf-5357380837f2 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:37.385545 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:37.442987 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f320d74-a5ed-48c0-abcf-5357380837f2 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:37.483613 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33657e7c-c67b-4028-92bd-b578288946ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:37.484651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33657e7c-c67b-4028-92bd-b578288946ab None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:37.485159 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33657e7c-c67b-4028-92bd-b578288946ab None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:37.485643 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33657e7c-c67b-4028-92bd-b578288946ab None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:37.486631 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33657e7c-c67b-4028-92bd-b578288946ab None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:37.487137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33657e7c-c67b-4028-92bd-b578288946ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:37.488701 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33657e7c-c67b-4028-92bd-b578288946ab None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:37.498592 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 191/384] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:37.504166 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eda34f-ef12-41e8-b191-674ab0c2f0db None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:37.651127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eda34f-ef12-41e8-b191-674ab0c2f0db None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:37.693732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2403d-ae5b-4396-b815-10b029810ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:37.694624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2403d-ae5b-4396-b815-10b029810ef6 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:37.694913 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2403d-ae5b-4396-b815-10b029810ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:37.695194 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2403d-ae5b-4396-b815-10b029810ef6 None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:37.699029 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2403d-ae5b-4396-b815-10b029810ef6 None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:37.700503 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2403d-ae5b-4396-b815-10b029810ef6 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:37.702150 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 194/385] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:37 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:37.707679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33657e7c-c67b-4028-92bd-b578288946ab None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:37.888617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33657e7c-c67b-4028-92bd-b578288946ab None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:37.935042 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:37.949538 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b9073-0bdc-4746-88d6-4148751b4def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:37.950447 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b9073-0bdc-4746-88d6-4148751b4def None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:37.950742 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b9073-0bdc-4746-88d6-4148751b4def None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:37.951679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b9073-0bdc-4746-88d6-4148751b4def None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:37.952225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b9073-0bdc-4746-88d6-4148751b4def None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:37.953690 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b9073-0bdc-4746-88d6-4148751b4def None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:37.955742 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 192/386] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:37 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:37.961117 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2403d-ae5b-4396-b815-10b029810ef6 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:37.983335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:38.112829 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2403d-ae5b-4396-b815-10b029810ef6 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:38.155500 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b73014-c21b-4f49-8e93-fb52ee3f47b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:38.156657 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b73014-c21b-4f49-8e93-fb52ee3f47b6 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:38.157092 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b73014-c21b-4f49-8e93-fb52ee3f47b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:38.157549 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b73014-c21b-4f49-8e93-fb52ee3f47b6 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/groups/0ed4730d02d74b6192703e26b4adafb4/roles/030683e4ff8d4d1587d99164f75c0fb8` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:38.159915 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b73014-c21b-4f49-8e93-fb52ee3f47b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9017adacd6f4b29adabe3bdb6713cc5, group_id=0ed4730d02d74b6192703e26b4adafb4, role_id=030683e4ff8d4d1587d99164f75c0fb8)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:38.161567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b73014-c21b-4f49-8e93-fb52ee3f47b6 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:38.224753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 195/387] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jun 6 06:56:37 2022] PUT /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/groups/0ed4730d02d74b6192703e26b4adafb4/roles/030683e4ff8d4d1587d99164f75c0fb8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:38.773142 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5afaff-a160-4f1a-bf8b-7fbf75560842 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:38.773693 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5afaff-a160-4f1a-bf8b-7fbf75560842 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:38.773693 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5afaff-a160-4f1a-bf8b-7fbf75560842 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:38.775409 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 193/388] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:38.780647 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5780c18-5799-44d8-87b9-62fba522f95f None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:38.781044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5780c18-5799-44d8-87b9-62fba522f95f None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:38.781206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5780c18-5799-44d8-87b9-62fba522f95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:38.802749 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-a5780c18-5799-44d8-87b9-62fba522f95f None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:38.803947 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-a5780c18-5799-44d8-87b9-62fba522f95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:38.881701 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:38.887357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 196/389] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:38.934700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5afaff-a160-4f1a-bf8b-7fbf75560842 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:39.062685 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5afaff-a160-4f1a-bf8b-7fbf75560842 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:39.111164 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437298-2c07-4a01-9360-7b5ecef9cae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:39.112207 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437298-2c07-4a01-9360-7b5ecef9cae0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:39.112643 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437298-2c07-4a01-9360-7b5ecef9cae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:39.113103 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437298-2c07-4a01-9360-7b5ecef9cae0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:39.124452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a437298-2c07-4a01-9360-7b5ecef9cae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-1a437298-2c07-4a01-9360-7b5ecef9cae0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:39.132775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:39.133881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:39.134971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:39.137298 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 194/390] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:39.142655 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5780c18-5799-44d8-87b9-62fba522f95f None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:39.286940 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5780c18-5799-44d8-87b9-62fba522f95f None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:39.325863 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a2a0-8581-42b6-b1de-86ca351045b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:39.326565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a2a0-8581-42b6-b1de-86ca351045b3 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:39.326851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a2a0-8581-42b6-b1de-86ca351045b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:39.327131 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a2a0-8581-42b6-b1de-86ca351045b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:39.327888 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a2a0-8581-42b6-b1de-86ca351045b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:39.328196 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a2a0-8581-42b6-b1de-86ca351045b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:39.329575 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a2a0-8581-42b6-b1de-86ca351045b3 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:39.339131 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 197/391] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:39.344732 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437298-2c07-4a01-9360-7b5ecef9cae0 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:39.418982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:39.491622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437298-2c07-4a01-9360-7b5ecef9cae0 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:39.533867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926fd02-db1c-4c6b-a881-98acfd1cef68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:39.534765 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926fd02-db1c-4c6b-a881-98acfd1cef68 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:39.535051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926fd02-db1c-4c6b-a881-98acfd1cef68 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:39.535324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926fd02-db1c-4c6b-a881-98acfd1cef68 None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:39.536566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926fd02-db1c-4c6b-a881-98acfd1cef68 None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:39.538003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926fd02-db1c-4c6b-a881-98acfd1cef68 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:39.539839 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 195/392] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:39 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:39.545543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a2a0-8581-42b6-b1de-86ca351045b3 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:39.567907 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da441d-b224-46c9-b7e2-e9585c5ee8a1 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:39.568232 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da441d-b224-46c9-b7e2-e9585c5ee8a1 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:39.568597 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da441d-b224-46c9-b7e2-e9585c5ee8a1 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:39.572052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 196/393] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:39.576262 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2255385-705c-4e49-abf3-e66b1e57ee73 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:39.576501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2255385-705c-4e49-abf3-e66b1e57ee73 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:39.576788 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2255385-705c-4e49-abf3-e66b1e57ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:39.596278 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-f2255385-705c-4e49-abf3-e66b1e57ee73 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:39.597624 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-f2255385-705c-4e49-abf3-e66b1e57ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:39.644833 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:39.686220 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 197/394] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:39.688074 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c0760-7e83-4328-983c-c6af36cc538f None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:39.688609 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c0760-7e83-4328-983c-c6af36cc538f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:39.689144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c0760-7e83-4328-983c-c6af36cc538f None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:39.690700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 198/395] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:39.696142 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130801-fa60-4c79-9b53-281f249f1df3 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:39.696684 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130801-fa60-4c79-9b53-281f249f1df3 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:39.697231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130801-fa60-4c79-9b53-281f249f1df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:39.720318 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a2a0-8581-42b6-b1de-86ca351045b3 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:39.726056 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-46130801-fa60-4c79-9b53-281f249f1df3 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:39.728063 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-46130801-fa60-4c79-9b53-281f249f1df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:39.775149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf561e-8075-45e4-bdd3-a8e0c23377b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:39.776492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf561e-8075-45e4-bdd3-a8e0c23377b2 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:39.776985 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf561e-8075-45e4-bdd3-a8e0c23377b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:39.777590 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf561e-8075-45e4-bdd3-a8e0c23377b2 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:39.779043 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf561e-8075-45e4-bdd3-a8e0c23377b2 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:39.780699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf561e-8075-45e4-bdd3-a8e0c23377b2 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:39.783457 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 198/396] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:39 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:39.784585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf561e-8075-45e4-bdd3-a8e0c23377b2 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:39.790356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:39.825227 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 199/397] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:39.826058 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46130801-fa60-4c79-9b53-281f249f1df3 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:39.947145 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf561e-8075-45e4-bdd3-a8e0c23377b2 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:39.980374 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46130801-fa60-4c79-9b53-281f249f1df3 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:39.984867 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:39.991295 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6f1d1-d194-4315-8849-4a510411cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:39.992629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6f1d1-d194-4315-8849-4a510411cf70 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:39.993495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6f1d1-d194-4315-8849-4a510411cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:39.993784 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6f1d1-d194-4315-8849-4a510411cf70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.007554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6f1d1-d194-4315-8849-4a510411cf70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-10f6f1d1-d194-4315-8849-4a510411cf70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:40.020174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:40.021087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:40.021892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:40.025201 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 199/398] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:40.025837 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089d0ec-14b7-46de-9c3a-a9f153047da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.026096 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6f1d1-d194-4315-8849-4a510411cf70 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.027191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089d0ec-14b7-46de-9c3a-a9f153047da6 None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.027819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089d0ec-14b7-46de-9c3a-a9f153047da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.028430 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089d0ec-14b7-46de-9c3a-a9f153047da6 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4/groups/0ed4730d02d74b6192703e26b4adafb4/roles/030683e4ff8d4d1587d99164f75c0fb8` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.030753 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089d0ec-14b7-46de-9c3a-a9f153047da6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ac856d373a44118058b6acc934e6e4, group_id=0ed4730d02d74b6192703e26b4adafb4, role_id=030683e4ff8d4d1587d99164f75c0fb8)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:40.032446 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089d0ec-14b7-46de-9c3a-a9f153047da6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:40.087871 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 200/399] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jun 6 06:56:39 2022] PUT /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4/groups/0ed4730d02d74b6192703e26b4adafb4/roles/030683e4ff8d4d1587d99164f75c0fb8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:40.089366 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089d0ec-14b7-46de-9c3a-a9f153047da6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.135971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:40.152975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6f1d1-d194-4315-8849-4a510411cf70 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:40.231982 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a971277-ba87-4e00-9872-1144e64b756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.233160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971277-ba87-4e00-9872-1144e64b756b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.234727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971277-ba87-4e00-9872-1144e64b756b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.235245 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971277-ba87-4e00-9872-1144e64b756b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.262080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a971277-ba87-4e00-9872-1144e64b756b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:40.269272 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089d0ec-14b7-46de-9c3a-a9f153047da6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-0a971277-ba87-4e00-9872-1144e64b756b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:40.270310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:40.271259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:40.272527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 200/400] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:40.273436 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85545754-fbfa-49a2-8329-742288a45890 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.273672 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85545754-fbfa-49a2-8329-742288a45890 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.273823 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85545754-fbfa-49a2-8329-742288a45890 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.279366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 201/401] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:40.280325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85545754-fbfa-49a2-8329-742288a45890 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.319501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fede6-10c8-4e18-aedb-cec83718b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.320561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fede6-10c8-4e18-aedb-cec83718b79e None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.321104 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fede6-10c8-4e18-aedb-cec83718b79e None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.321647 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fede6-10c8-4e18-aedb-cec83718b79e None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.323318 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fede6-10c8-4e18-aedb-cec83718b79e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:40.323737 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fede6-10c8-4e18-aedb-cec83718b79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:40.325128 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fede6-10c8-4e18-aedb-cec83718b79e None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:40.334018 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 201/402] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:40.335349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abe768-e3b8-402d-ab90-b67a106ed205 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.335757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abe768-e3b8-402d-ab90-b67a106ed205 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.336049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abe768-e3b8-402d-ab90-b67a106ed205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.342923 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:40.354235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-80abe768-e3b8-402d-ab90-b67a106ed205 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:40.355803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-80abe768-e3b8-402d-ab90-b67a106ed205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:40.407727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85545754-fbfa-49a2-8329-742288a45890 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:40.440167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 202/403] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:40.441805 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abe768-e3b8-402d-ab90-b67a106ed205 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.460599 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b7f0a-a4fe-43db-b717-0a5d6ddbb42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.461282 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b7f0a-a4fe-43db-b717-0a5d6ddbb42c None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.461562 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b7f0a-a4fe-43db-b717-0a5d6ddbb42c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.461865 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b7f0a-a4fe-43db-b717-0a5d6ddbb42c None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.463117 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b7f0a-a4fe-43db-b717-0a5d6ddbb42c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:40.463627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b7f0a-a4fe-43db-b717-0a5d6ddbb42c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:40.465791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b7f0a-a4fe-43db-b717-0a5d6ddbb42c None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:40.479376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 202/404] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:40.480333 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b7f0a-a4fe-43db-b717-0a5d6ddbb42c None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.487477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:40.576568 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abe768-e3b8-402d-ab90-b67a106ed205 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:40.603820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b7f0a-a4fe-43db-b717-0a5d6ddbb42c None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:40.613968 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5c633-bb7d-4450-8a32-6959febf0a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.614961 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5c633-bb7d-4450-8a32-6959febf0a97 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.615251 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5c633-bb7d-4450-8a32-6959febf0a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.615532 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5c633-bb7d-4450-8a32-6959febf0a97 None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.616727 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5c633-bb7d-4450-8a32-6959febf0a97 None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:40.617441 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:40.619714 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5c633-bb7d-4450-8a32-6959febf0a97 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:40.621854 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 203/405] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:40 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:40.622784 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5c633-bb7d-4450-8a32-6959febf0a97 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.646701 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483465c-824f-4197-98a9-839ae8c9cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.647515 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483465c-824f-4197-98a9-839ae8c9cc37 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.647804 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483465c-824f-4197-98a9-839ae8c9cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.648086 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483465c-824f-4197-98a9-839ae8c9cc37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.660253 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483465c-824f-4197-98a9-839ae8c9cc37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-2483465c-824f-4197-98a9-839ae8c9cc37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:40.668501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:40.669377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:40.670149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:40.674579 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 203/406] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:40.675366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483465c-824f-4197-98a9-839ae8c9cc37 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.736678 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:40.754748 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5c633-bb7d-4450-8a32-6959febf0a97 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:40.789275 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483465c-824f-4197-98a9-839ae8c9cc37 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:40.797304 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905674d-44b0-4fee-b3af-0c2ab270e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.798734 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905674d-44b0-4fee-b3af-0c2ab270e017 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.799207 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905674d-44b0-4fee-b3af-0c2ab270e017 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.799706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905674d-44b0-4fee-b3af-0c2ab270e017 None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.801081 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905674d-44b0-4fee-b3af-0c2ab270e017 None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:40.802744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905674d-44b0-4fee-b3af-0c2ab270e017 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:40.804917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 204/407] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:40 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:40.805945 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905674d-44b0-4fee-b3af-0c2ab270e017 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.826024 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4bdbf-5c2e-493e-9782-c0648de14d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.827199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4bdbf-5c2e-493e-9782-c0648de14d25 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.827497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4bdbf-5c2e-493e-9782-c0648de14d25 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.827781 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4bdbf-5c2e-493e-9782-c0648de14d25 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.828989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4bdbf-5c2e-493e-9782-c0648de14d25 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:40.830481 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4bdbf-5c2e-493e-9782-c0648de14d25 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:40.837744 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 204/408] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:40 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:40.838485 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4bdbf-5c2e-493e-9782-c0648de14d25 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.886982 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:40.921161 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905674d-44b0-4fee-b3af-0c2ab270e017 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:40.953445 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4bdbf-5c2e-493e-9782-c0648de14d25 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:40.957454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324c0e8-38a3-4e59-8d6e-9d58f503e7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.958402 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324c0e8-38a3-4e59-8d6e-9d58f503e7e7 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.958896 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324c0e8-38a3-4e59-8d6e-9d58f503e7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.959413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324c0e8-38a3-4e59-8d6e-9d58f503e7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.960406 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324c0e8-38a3-4e59-8d6e-9d58f503e7e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:40.960901 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324c0e8-38a3-4e59-8d6e-9d58f503e7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:40.963084 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324c0e8-38a3-4e59-8d6e-9d58f503e7e7 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:40.972494 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 205/409] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:40.973597 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324c0e8-38a3-4e59-8d6e-9d58f503e7e7 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:40.996366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858224-99df-49b1-928f-2e25fb366481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:40.997324 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858224-99df-49b1-928f-2e25fb366481 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:40.997617 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858224-99df-49b1-928f-2e25fb366481 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:40.997898 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858224-99df-49b1-928f-2e25fb366481 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:40.999156 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8858224-99df-49b1-928f-2e25fb366481 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:41.001016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8858224-99df-49b1-928f-2e25fb366481 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:41.003015 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 205/410] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:40 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:41.003896 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858224-99df-49b1-928f-2e25fb366481 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:41.009417 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:41.085459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324c0e8-38a3-4e59-8d6e-9d58f503e7e7 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:41.116246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858224-99df-49b1-928f-2e25fb366481 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:41.122491 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a93b-7a24-4f8f-a02f-e6f9f700ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:41.123465 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a93b-7a24-4f8f-a02f-e6f9f700ef05 None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:41.123828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a93b-7a24-4f8f-a02f-e6f9f700ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:41.124183 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a93b-7a24-4f8f-a02f-e6f9f700ef05 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4/groups/0ed4730d02d74b6192703e26b4adafb4/roles/33a7efc2edd44d81bc33bfd6d02c61cb` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:41.126563 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933a93b-7a24-4f8f-a02f-e6f9f700ef05 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ac856d373a44118058b6acc934e6e4, group_id=0ed4730d02d74b6192703e26b4adafb4, role_id=33a7efc2edd44d81bc33bfd6d02c61cb)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:41.127558 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:41.128426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933a93b-7a24-4f8f-a02f-e6f9f700ef05 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:41.154284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a967dd-b954-42c6-9d23-fc4a4b4c8a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:41.155472 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a967dd-b954-42c6-9d23-fc4a4b4c8a33 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:41.156113 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a967dd-b954-42c6-9d23-fc4a4b4c8a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:41.156545 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a967dd-b954-42c6-9d23-fc4a4b4c8a33 None admin] PATH_INFO: `/v3/groups/801a518589a7483396fdbdb796da45f6` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:41.157766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a967dd-b954-42c6-9d23-fc4a4b4c8a33 None admin] RBAC: Authorizing `identity:get_group(group_id=801a518589a7483396fdbdb796da45f6)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:41.159335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a967dd-b954-42c6-9d23-fc4a4b4c8a33 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:41.161159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 206/411] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:41 2022] GET /identity/v3/groups/801a518589a7483396fdbdb796da45f6 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:41.161742 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a967dd-b954-42c6-9d23-fc4a4b4c8a33 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:41.200792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 206/412] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jun 6 06:56:40 2022] PUT /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4/groups/0ed4730d02d74b6192703e26b4adafb4/roles/33a7efc2edd44d81bc33bfd6d02c61cb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:41.201995 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a93b-7a24-4f8f-a02f-e6f9f700ef05 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:41.329212 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a967dd-b954-42c6-9d23-fc4a4b4c8a33 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:41.340051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:41.362640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a93b-7a24-4f8f-a02f-e6f9f700ef05 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:41.375619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58558a98-522c-4b62-94e0-fede1aff0410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:41.379437 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58558a98-522c-4b62-94e0-fede1aff0410 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:41.379437 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58558a98-522c-4b62-94e0-fede1aff0410 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:41.379437 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58558a98-522c-4b62-94e0-fede1aff0410 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/groups/0ed4730d02d74b6192703e26b4adafb4/roles/33a7efc2edd44d81bc33bfd6d02c61cb` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:41.380401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58558a98-522c-4b62-94e0-fede1aff0410 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9017adacd6f4b29adabe3bdb6713cc5, group_id=0ed4730d02d74b6192703e26b4adafb4, role_id=33a7efc2edd44d81bc33bfd6d02c61cb)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:41.382066 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58558a98-522c-4b62-94e0-fede1aff0410 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:41.410172 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdd969-7914-4e8b-a198-e10294043325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:41.411448 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdd969-7914-4e8b-a198-e10294043325 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:41.412130 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdd969-7914-4e8b-a198-e10294043325 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:41.412635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdd969-7914-4e8b-a198-e10294043325 None admin] PATH_INFO: `/v3/projects/0d774be4b4f647c4aa73f115724f3d96` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:41.414625 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdd969-7914-4e8b-a198-e10294043325 None admin] RBAC: Authorizing `identity:get_project(project_id=0d774be4b4f647c4aa73f115724f3d96)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:41.416959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdd969-7914-4e8b-a198-e10294043325 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:41.419352 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 207/413] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:41 2022] GET /identity/v3/projects/0d774be4b4f647c4aa73f115724f3d96 => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:41.421019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca05a7-f5c5-41d8-95fe-12eb4e24fdaa None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:41.421447 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca05a7-f5c5-41d8-95fe-12eb4e24fdaa None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:41.421855 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca05a7-f5c5-41d8-95fe-12eb4e24fdaa None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:41.423348 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 208/414] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:41.424776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca05a7-f5c5-41d8-95fe-12eb4e24fdaa None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:41.478576 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 207/415] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jun 6 06:56:41 2022] PUT /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5/groups/0ed4730d02d74b6192703e26b4adafb4/roles/33a7efc2edd44d81bc33bfd6d02c61cb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:41.480345 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cdec-81d1-46b6-a1d3-c5907210d9b9 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:41.480746 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cdec-81d1-46b6-a1d3-c5907210d9b9 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:41.481167 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cdec-81d1-46b6-a1d3-c5907210d9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:41.513774 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-0db5cdec-81d1-46b6-a1d3-c5907210d9b9 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:41.515349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-0db5cdec-81d1-46b6-a1d3-c5907210d9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:41.556024 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:41.570957 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca05a7-f5c5-41d8-95fe-12eb4e24fdaa None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:41.600108 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 208/416] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:41.633121 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94faa8-f7b3-4cce-b331-c590f671c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:41.634401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94faa8-f7b3-4cce-b331-c590f671c63d None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:41.634852 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94faa8-f7b3-4cce-b331-c590f671c63d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:41.635284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94faa8-f7b3-4cce-b331-c590f671c63d None admin] PATH_INFO: `/v3/projects/0d774be4b4f647c4aa73f115724f3d96/groups/801a518589a7483396fdbdb796da45f6/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:41.637554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94faa8-f7b3-4cce-b331-c590f671c63d None admin] RBAC: Authorizing `identity:create_grant(project_id=0d774be4b4f647c4aa73f115724f3d96, group_id=801a518589a7483396fdbdb796da45f6, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:41.639261 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94faa8-f7b3-4cce-b331-c590f671c63d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:41.657693 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5cdec-81d1-46b6-a1d3-c5907210d9b9 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:41.750758 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 209/417] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Jun 6 06:56:41 2022] PUT /identity/v3/projects/0d774be4b4f647c4aa73f115724f3d96/groups/801a518589a7483396fdbdb796da45f6/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:56:41.780018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5cdec-81d1-46b6-a1d3-c5907210d9b9 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:41.821977 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236911-4665-47f8-b300-f5c7f09e48a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:41.822837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236911-4665-47f8-b300-f5c7f09e48a2 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:41.823125 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236911-4665-47f8-b300-f5c7f09e48a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:41.823405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236911-4665-47f8-b300-f5c7f09e48a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:41.835921 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe236911-4665-47f8-b300-f5c7f09e48a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-fe236911-4665-47f8-b300-f5c7f09e48a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:41.844771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:41.845727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:41.846581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:41.847197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 209/418] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:41.854283 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94faa8-f7b3-4cce-b331-c590f671c63d None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:41.879833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:41.979740 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94faa8-f7b3-4cce-b331-c590f671c63d None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:42.018909 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d86675-654c-49cf-b1af-55ab03e327ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:42.019608 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d86675-654c-49cf-b1af-55ab03e327ac None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:42.019899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d86675-654c-49cf-b1af-55ab03e327ac None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:42.020179 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d86675-654c-49cf-b1af-55ab03e327ac None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:42.020951 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d86675-654c-49cf-b1af-55ab03e327ac None admin] RBAC: Adding query filter params (name=member) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:42.021262 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d86675-654c-49cf-b1af-55ab03e327ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:42.022694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d86675-654c-49cf-b1af-55ab03e327ac None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:42.032626 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 210/419] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:42.038149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236911-4665-47f8-b300-f5c7f09e48a2 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:42.078938 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:42.159893 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236911-4665-47f8-b300-f5c7f09e48a2 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:42.210083 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a527776-fbd2-4a0d-8072-9c450fd3d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:42.210779 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527776-fbd2-4a0d-8072-9c450fd3d255 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:42.211071 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527776-fbd2-4a0d-8072-9c450fd3d255 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:42.211349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527776-fbd2-4a0d-8072-9c450fd3d255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:42.281251 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a527776-fbd2-4a0d-8072-9c450fd3d255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:42.282754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a527776-fbd2-4a0d-8072-9c450fd3d255 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:42.309401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:42.404750 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 210/420] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:42.410184 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d86675-654c-49cf-b1af-55ab03e327ac None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:42.528384 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:42.556153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d86675-654c-49cf-b1af-55ab03e327ac None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:42.621201 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30635fc8-1755-42a7-acb1-5f66f158f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:42.622286 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30635fc8-1755-42a7-acb1-5f66f158f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:42.622736 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30635fc8-1755-42a7-acb1-5f66f158f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:42.623152 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30635fc8-1755-42a7-acb1-5f66f158f1c1 None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:42.625030 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30635fc8-1755-42a7-acb1-5f66f158f1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:42.627587 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30635fc8-1755-42a7-acb1-5f66f158f1c1 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:42.630438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 211/421] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:42 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:42.639657 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a527776-fbd2-4a0d-8072-9c450fd3d255 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:42.758309 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a527776-fbd2-4a0d-8072-9c450fd3d255 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:42.789522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:42.801002 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe95d7-9f36-4815-a04c-c8d646a8c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:42.802231 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe95d7-9f36-4815-a04c-c8d646a8c1de None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:42.802761 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe95d7-9f36-4815-a04c-c8d646a8c1de None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:42.803271 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe95d7-9f36-4815-a04c-c8d646a8c1de None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:42.804675 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe95d7-9f36-4815-a04c-c8d646a8c1de None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:42.806387 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe95d7-9f36-4815-a04c-c8d646a8c1de None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:42.808221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 211/422] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:42 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:42.814405 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30635fc8-1755-42a7-acb1-5f66f158f1c1 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:42.903329 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74348958-5bca-4b3d-b0ba-9c902b609b28 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:42.904403 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74348958-5bca-4b3d-b0ba-9c902b609b28 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:42.905038 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74348958-5bca-4b3d-b0ba-9c902b609b28 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:42.906785 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 212/423] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:42.912834 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a14b-2197-4706-b073-b472afbeefbc None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:42.919128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a14b-2197-4706-b073-b472afbeefbc None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:42.919128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a14b-2197-4706-b073-b472afbeefbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:42.954288 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-adf9a14b-2197-4706-b073-b472afbeefbc None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:42.955538 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-adf9a14b-2197-4706-b073-b472afbeefbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:42.992798 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30635fc8-1755-42a7-acb1-5f66f158f1c1 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:43.057936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2c0f1-6b01-40e3-894e-c6c347dc02b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:43.058548 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2c0f1-6b01-40e3-894e-c6c347dc02b6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:43.058837 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2c0f1-6b01-40e3-894e-c6c347dc02b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:43.059122 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2c0f1-6b01-40e3-894e-c6c347dc02b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:43.059968 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2c0f1-6b01-40e3-894e-c6c347dc02b6 None admin] RBAC: Adding query filter params (group.id=0ed4730d02d74b6192703e26b4adafb4, role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:43.060289 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2c0f1-6b01-40e3-894e-c6c347dc02b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:43.062042 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2c0f1-6b01-40e3-894e-c6c347dc02b6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:43.073941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 212/424] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:42 2022] GET /identity/v3/role_assignments?group.id=0ed4730d02d74b6192703e26b4adafb4&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:43.080686 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 213/425] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:43.106052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2c0f1-6b01-40e3-894e-c6c347dc02b6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:43.120534 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:43.262026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2c0f1-6b01-40e3-894e-c6c347dc02b6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:43.302617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801adb8-b6cb-42f4-8f3e-7350a9445972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:43.303435 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801adb8-b6cb-42f4-8f3e-7350a9445972 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:43.303720 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801adb8-b6cb-42f4-8f3e-7350a9445972 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:43.304053 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801adb8-b6cb-42f4-8f3e-7350a9445972 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:43.317411 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801adb8-b6cb-42f4-8f3e-7350a9445972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-2801adb8-b6cb-42f4-8f3e-7350a9445972 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:43.325314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:43.326265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 06 06:56:43.327106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:43.330465 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 213/426] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:43.333055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9a14b-2197-4706-b073-b472afbeefbc None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:43.441108 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9a14b-2197-4706-b073-b472afbeefbc None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:43.469658 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:43.484136 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dec8d0-bb84-4ab5-b404-9bcd02c2927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:43.484836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dec8d0-bb84-4ab5-b404-9bcd02c2927b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:43.485123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dec8d0-bb84-4ab5-b404-9bcd02c2927b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:43.485403 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dec8d0-bb84-4ab5-b404-9bcd02c2927b None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:43.493396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dec8d0-bb84-4ab5-b404-9bcd02c2927b None admin] RBAC: Adding query filter params (name=member) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:43.493396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dec8d0-bb84-4ab5-b404-9bcd02c2927b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:43.493396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dec8d0-bb84-4ab5-b404-9bcd02c2927b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:43.499163 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 214/427] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:56:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:43.505259 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801adb8-b6cb-42f4-8f3e-7350a9445972 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:43.578637 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:43.622660 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801adb8-b6cb-42f4-8f3e-7350a9445972 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:43.669490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8921c1-f923-4bac-b80f-df286a2cbca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:43.670150 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8921c1-f923-4bac-b80f-df286a2cbca7 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:43.670495 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8921c1-f923-4bac-b80f-df286a2cbca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:43.670828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8921c1-f923-4bac-b80f-df286a2cbca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:43.752950 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8921c1-f923-4bac-b80f-df286a2cbca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:43.754514 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8921c1-f923-4bac-b80f-df286a2cbca7 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:43.832940 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:43.878446 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 214/428] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:43.880909 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dec8d0-bb84-4ab5-b404-9bcd02c2927b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:44.017113 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b92885-c3a2-4739-ae83-3b064f5834f7 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.017633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b92885-c3a2-4739-ae83-3b064f5834f7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.017892 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b92885-c3a2-4739-ae83-3b064f5834f7 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.021770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 215/429] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:44.024170 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dec8d0-bb84-4ab5-b404-9bcd02c2927b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:44.025890 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc6430-ea72-4db3-b7d3-24404bbc1e2f None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.026190 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc6430-ea72-4db3-b7d3-24404bbc1e2f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.026515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc6430-ea72-4db3-b7d3-24404bbc1e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.060395 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-8ffc6430-ea72-4db3-b7d3-24404bbc1e2f None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:44.062191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-8ffc6430-ea72-4db3-b7d3-24404bbc1e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:44.065291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658e676-544c-4102-a7ac-1b8a1c1979aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:44.066110 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658e676-544c-4102-a7ac-1b8a1c1979aa None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.066434 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658e676-544c-4102-a7ac-1b8a1c1979aa None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.066718 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658e676-544c-4102-a7ac-1b8a1c1979aa None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.068642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658e676-544c-4102-a7ac-1b8a1c1979aa None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:44.070091 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658e676-544c-4102-a7ac-1b8a1c1979aa None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:44.074655 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 215/430] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:43 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:44.077953 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658e676-544c-4102-a7ac-1b8a1c1979aa None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:44.137513 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:44.148217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 216/431] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:44.178143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc6430-ea72-4db3-b7d3-24404bbc1e2f None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:44.187960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658e676-544c-4102-a7ac-1b8a1c1979aa None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:44.224507 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1f7c3-aaef-45e8-a4f0-21428d6df2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:44.225375 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1f7c3-aaef-45e8-a4f0-21428d6df2cd None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.225658 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1f7c3-aaef-45e8-a4f0-21428d6df2cd None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.225938 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1f7c3-aaef-45e8-a4f0-21428d6df2cd None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.227681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1f7c3-aaef-45e8-a4f0-21428d6df2cd None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:44.229377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1f7c3-aaef-45e8-a4f0-21428d6df2cd None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:44.231455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 216/432] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:44 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:44.237204 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1f7c3-aaef-45e8-a4f0-21428d6df2cd None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:44.299842 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc6430-ea72-4db3-b7d3-24404bbc1e2f None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:44.308334 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:44.338610 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00a50-6ef0-4217-9487-69cfdb060f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:44.340092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00a50-6ef0-4217-9487-69cfdb060f51 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.340662 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00a50-6ef0-4217-9487-69cfdb060f51 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.341111 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00a50-6ef0-4217-9487-69cfdb060f51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.353014 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00a50-6ef0-4217-9487-69cfdb060f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-03c00a50-6ef0-4217-9487-69cfdb060f51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:44.362019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:44.363048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:44.363846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:44.364465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1f7c3-aaef-45e8-a4f0-21428d6df2cd None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:44.371518 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 217/433] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:44.372657 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00a50-6ef0-4217-9487-69cfdb060f51 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:44.390572 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:44.404625 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d9b48-dfdb-4035-921b-be5ed405808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:44.405585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d9b48-dfdb-4035-921b-be5ed405808f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.406174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d9b48-dfdb-4035-921b-be5ed405808f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.406586 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d9b48-dfdb-4035-921b-be5ed405808f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.407738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d9b48-dfdb-4035-921b-be5ed405808f None admin] RBAC: Adding query filter params (group.id=0ed4730d02d74b6192703e26b4adafb4, role.id=030683e4ff8d4d1587d99164f75c0fb8, scope.project.id=d5ac856d373a44118058b6acc934e6e4) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:44.408285 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d9b48-dfdb-4035-921b-be5ed405808f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:44.410007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d9b48-dfdb-4035-921b-be5ed405808f None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:44.416880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 217/434] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:44 2022] GET /identity/v3/role_assignments?group.id=0ed4730d02d74b6192703e26b4adafb4&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=030683e4ff8d4d1587d99164f75c0fb8 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:44.426617 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8674-75a4-4961-ab47-a2e95756d53c None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.426905 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8674-75a4-4961-ab47-a2e95756d53c None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.427185 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8674-75a4-4961-ab47-a2e95756d53c None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.428752 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 218/435] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:44.435018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23653-9656-4022-bdf2-bc6eb2fdb3ce None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.435308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23653-9656-4022-bdf2-bc6eb2fdb3ce None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.435597 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23653-9656-4022-bdf2-bc6eb2fdb3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.454360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-28a23653-9656-4022-bdf2-bc6eb2fdb3ce None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:44.455573 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-28a23653-9656-4022-bdf2-bc6eb2fdb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:44.511997 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00a50-6ef0-4217-9487-69cfdb060f51 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:44.542849 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 219/436] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:44.558647 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3de305-4e54-4aa0-812c-ed5f689ad8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:44.559725 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de305-4e54-4aa0-812c-ed5f689ad8c6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.560225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de305-4e54-4aa0-812c-ed5f689ad8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.560729 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de305-4e54-4aa0-812c-ed5f689ad8c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.561714 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3de305-4e54-4aa0-812c-ed5f689ad8c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:44.562315 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3de305-4e54-4aa0-812c-ed5f689ad8c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:44.563534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23653-9656-4022-bdf2-bc6eb2fdb3ce None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:44.564204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3de305-4e54-4aa0-812c-ed5f689ad8c6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:44.577352 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 218/437] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:44.583341 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3de305-4e54-4aa0-812c-ed5f689ad8c6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:44.608146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:44.685159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23653-9656-4022-bdf2-bc6eb2fdb3ce None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:44.701223 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3de305-4e54-4aa0-812c-ed5f689ad8c6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:44.709314 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:44.737835 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e00f-d6dc-4a25-abd5-408922bfbcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:44.738951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e00f-d6dc-4a25-abd5-408922bfbcab None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.739234 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e00f-d6dc-4a25-abd5-408922bfbcab None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.739508 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e00f-d6dc-4a25-abd5-408922bfbcab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.747251 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8412e93-91ee-400d-b523-6f1507bcf963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:44.748067 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8412e93-91ee-400d-b523-6f1507bcf963 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.748621 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8412e93-91ee-400d-b523-6f1507bcf963 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.748913 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8412e93-91ee-400d-b523-6f1507bcf963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.751078 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87e00f-d6dc-4a25-abd5-408922bfbcab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-5f87e00f-d6dc-4a25-abd5-408922bfbcab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:44.761714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:44.762706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 06 06:56:44.763499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:44.764120 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 220/438] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:56:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:44.769263 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e00f-d6dc-4a25-abd5-408922bfbcab None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:44.823109 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8412e93-91ee-400d-b523-6f1507bcf963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:44.824598 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8412e93-91ee-400d-b523-6f1507bcf963 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:44.847352 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:44.873966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e00f-d6dc-4a25-abd5-408922bfbcab None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:44.909338 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2a8a9-ce0f-4103-a10c-0957754e137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:44.912270 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2a8a9-ce0f-4103-a10c-0957754e137e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.912663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2a8a9-ce0f-4103-a10c-0957754e137e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.915846 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2a8a9-ce0f-4103-a10c-0957754e137e None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.915846 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2a8a9-ce0f-4103-a10c-0957754e137e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:44.915846 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2a8a9-ce0f-4103-a10c-0957754e137e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:44.918646 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2a8a9-ce0f-4103-a10c-0957754e137e None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:44.928142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 221/439] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:44.929248 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a49627-2e15-4f0b-a64c-2fa0d796d113 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.929542 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a49627-2e15-4f0b-a64c-2fa0d796d113 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.929823 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a49627-2e15-4f0b-a64c-2fa0d796d113 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.931658 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 222/440] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:44.935602 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a49627-2e15-4f0b-a64c-2fa0d796d113 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:44.942256 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 219/441] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:44.943558 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b876f-e5e8-4766-9aae-ec0f09ce58bb None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:44.943852 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b876f-e5e8-4766-9aae-ec0f09ce58bb None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:44.944132 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b876f-e5e8-4766-9aae-ec0f09ce58bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:44.961288 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-7f8b876f-e5e8-4766-9aae-ec0f09ce58bb None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:44.962535 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-7f8b876f-e5e8-4766-9aae-ec0f09ce58bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:44.985490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:45.030040 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 220/442] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:45.030906 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b876f-e5e8-4766-9aae-ec0f09ce58bb None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:45.065010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a49627-2e15-4f0b-a64c-2fa0d796d113 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.079387 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:45.100612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b400c9-e772-4aee-af28-ba6e26bc1db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.100612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b400c9-e772-4aee-af28-ba6e26bc1db7 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.100612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b400c9-e772-4aee-af28-ba6e26bc1db7 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.100612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b400c9-e772-4aee-af28-ba6e26bc1db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:45.129372 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b876f-e5e8-4766-9aae-ec0f09ce58bb None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.163178 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e909f7c-9a2f-44ff-b192-cd742334d116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.164043 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909f7c-9a2f-44ff-b192-cd742334d116 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.164336 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909f7c-9a2f-44ff-b192-cd742334d116 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.164617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909f7c-9a2f-44ff-b192-cd742334d116 None admin] PATH_INFO: `/v3/projects/d5ac856d373a44118058b6acc934e6e4` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:45.166419 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e909f7c-9a2f-44ff-b192-cd742334d116 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ac856d373a44118058b6acc934e6e4)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:45.167867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e909f7c-9a2f-44ff-b192-cd742334d116 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:45.167995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b400c9-e772-4aee-af28-ba6e26bc1db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:45.169479 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b400c9-e772-4aee-af28-ba6e26bc1db7 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:45.169564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 221/443] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:45 2022] GET /identity/v3/projects/d5ac856d373a44118058b6acc934e6e4 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:45.170355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e909f7c-9a2f-44ff-b192-cd742334d116 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:45.208012 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:45.273983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 223/444] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:45.275360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b400c9-e772-4aee-af28-ba6e26bc1db7 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:45.282968 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e909f7c-9a2f-44ff-b192-cd742334d116 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.301029 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:45.317486 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b61b-d6f5-4e70-8818-51d4e62d988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.318325 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b61b-d6f5-4e70-8818-51d4e62d988f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.318747 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b61b-d6f5-4e70-8818-51d4e62d988f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.319032 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b61b-d6f5-4e70-8818-51d4e62d988f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:45.331279 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372b61b-d6f5-4e70-8818-51d4e62d988f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-5372b61b-d6f5-4e70-8818-51d4e62d988f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:45.339617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:45.340541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:45.341412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 222/445] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:45.342066 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b61b-d6f5-4e70-8818-51d4e62d988f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:45.375978 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b400c9-e772-4aee-af28-ba6e26bc1db7 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.410033 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b249c0-bd4b-4e09-82e7-7998718202d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.410913 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b249c0-bd4b-4e09-82e7-7998718202d0 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.411193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b249c0-bd4b-4e09-82e7-7998718202d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.411897 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b249c0-bd4b-4e09-82e7-7998718202d0 None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:45.412693 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b249c0-bd4b-4e09-82e7-7998718202d0 None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:45.414130 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b249c0-bd4b-4e09-82e7-7998718202d0 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:45.416362 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 224/446] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:45 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:45.417183 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b249c0-bd4b-4e09-82e7-7998718202d0 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:45.425360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:45.445423 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b61b-d6f5-4e70-8818-51d4e62d988f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.479067 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600b3c9-ddf4-4da5-8d5b-8e4c50615c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.479859 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600b3c9-ddf4-4da5-8d5b-8e4c50615c9d None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.480148 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600b3c9-ddf4-4da5-8d5b-8e4c50615c9d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.480429 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600b3c9-ddf4-4da5-8d5b-8e4c50615c9d None admin] PATH_INFO: `/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:45.481660 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600b3c9-ddf4-4da5-8d5b-8e4c50615c9d None admin] RBAC: Authorizing `identity:get_project(project_id=e9017adacd6f4b29adabe3bdb6713cc5)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:45.483132 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600b3c9-ddf4-4da5-8d5b-8e4c50615c9d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:45.484827 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 223/447] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:45 2022] GET /identity/v3/projects/e9017adacd6f4b29adabe3bdb6713cc5 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:45.485675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600b3c9-ddf4-4da5-8d5b-8e4c50615c9d None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:45.517006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b249c0-bd4b-4e09-82e7-7998718202d0 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.532862 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:45.551718 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ad073-685a-496d-b6c4-b7e1c11551d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.552735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ad073-685a-496d-b6c4-b7e1c11551d5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.553055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ad073-685a-496d-b6c4-b7e1c11551d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.553305 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ad073-685a-496d-b6c4-b7e1c11551d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:45.554079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ad073-685a-496d-b6c4-b7e1c11551d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:45.554429 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ad073-685a-496d-b6c4-b7e1c11551d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:45.555870 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ad073-685a-496d-b6c4-b7e1c11551d5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:45.564421 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 225/448] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:45.565243 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ad073-685a-496d-b6c4-b7e1c11551d5 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:45.596021 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600b3c9-ddf4-4da5-8d5b-8e4c50615c9d None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.628498 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06982f-3684-4317-8545-841d000311cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.629153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06982f-3684-4317-8545-841d000311cb None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.629438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06982f-3684-4317-8545-841d000311cb None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.629717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06982f-3684-4317-8545-841d000311cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:45.630583 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06982f-3684-4317-8545-841d000311cb None admin] RBAC: Adding query filter params (group.id=0ed4730d02d74b6192703e26b4adafb4, role.id=33a7efc2edd44d81bc33bfd6d02c61cb, scope.project.id=d5ac856d373a44118058b6acc934e6e4) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:45.630899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06982f-3684-4317-8545-841d000311cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:45.631062 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:45.632347 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06982f-3684-4317-8545-841d000311cb None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:45.638616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 224/449] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:45 2022] GET /identity/v3/role_assignments?group.id=0ed4730d02d74b6192703e26b4adafb4&scope.project.id=d5ac856d373a44118058b6acc934e6e4&role.id=33a7efc2edd44d81bc33bfd6d02c61cb => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:45.639393 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06982f-3684-4317-8545-841d000311cb None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:45.667729 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ad073-685a-496d-b6c4-b7e1c11551d5 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.709298 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cfcda-8d93-40e9-b746-712f55e45625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.710197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cfcda-8d93-40e9-b746-712f55e45625 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.710517 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cfcda-8d93-40e9-b746-712f55e45625 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.710801 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cfcda-8d93-40e9-b746-712f55e45625 None admin] PATH_INFO: `/v3/groups/0ed4730d02d74b6192703e26b4adafb4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:45.712775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cfcda-8d93-40e9-b746-712f55e45625 None admin] RBAC: Authorizing `identity:get_group(group_id=0ed4730d02d74b6192703e26b4adafb4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:45.714315 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cfcda-8d93-40e9-b746-712f55e45625 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:45.718725 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 226/450] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:45 2022] GET /identity/v3/groups/0ed4730d02d74b6192703e26b4adafb4 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:45.722723 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cfcda-8d93-40e9-b746-712f55e45625 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:45.835459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cfcda-8d93-40e9-b746-712f55e45625 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.877596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091ec12-fd61-4905-875e-f24a8d71659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.878266 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091ec12-fd61-4905-875e-f24a8d71659b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.878592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091ec12-fd61-4905-875e-f24a8d71659b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.878878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091ec12-fd61-4905-875e-f24a8d71659b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:45.879723 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091ec12-fd61-4905-875e-f24a8d71659b None admin] RBAC: Adding query filter params (group.id=0ed4730d02d74b6192703e26b4adafb4, role.id=33a7efc2edd44d81bc33bfd6d02c61cb, scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:45.880046 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091ec12-fd61-4905-875e-f24a8d71659b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:45.881495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091ec12-fd61-4905-875e-f24a8d71659b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:45.886625 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:45.889935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 227/451] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:45 2022] GET /identity/v3/role_assignments?group.id=0ed4730d02d74b6192703e26b4adafb4&scope.project.id=e9017adacd6f4b29adabe3bdb6713cc5&role.id=33a7efc2edd44d81bc33bfd6d02c61cb => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:45.893172 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06982f-3684-4317-8545-841d000311cb None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:45.905943 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:45.935901 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44256ad7-7af5-4700-a730-980961eccd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:45.936578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44256ad7-7af5-4700-a730-980961eccd67 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:45.936869 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44256ad7-7af5-4700-a730-980961eccd67 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:45.937148 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44256ad7-7af5-4700-a730-980961eccd67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:46.015115 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44256ad7-7af5-4700-a730-980961eccd67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:46.016627 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44256ad7-7af5-4700-a730-980961eccd67 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:46.125259 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 225/452] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:46.131029 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091ec12-fd61-4905-875e-f24a8d71659b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:46.233651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091ec12-fd61-4905-875e-f24a8d71659b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:46.268200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5c412-21dd-4d3b-8724-8855083851ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:46.269063 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5c412-21dd-4d3b-8724-8855083851ba None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:46.269351 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5c412-21dd-4d3b-8724-8855083851ba None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:46.269628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5c412-21dd-4d3b-8724-8855083851ba None admin] PATH_INFO: `/v3/projects/0d774be4b4f647c4aa73f115724f3d96` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:46.270827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5c412-21dd-4d3b-8724-8855083851ba None admin] RBAC: Authorizing `identity:get_project(project_id=0d774be4b4f647c4aa73f115724f3d96)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:46.272265 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5c412-21dd-4d3b-8724-8855083851ba None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:46.273940 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 228/453] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Jun 6 06:56:46 2022] GET /identity/v3/projects/0d774be4b4f647c4aa73f115724f3d96 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:46.279643 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44256ad7-7af5-4700-a730-980961eccd67 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:46.292043 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:46.382687 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44256ad7-7af5-4700-a730-980961eccd67 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:46.417089 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f1529-9ef8-494f-a211-d57cfcccac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:46.417951 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f1529-9ef8-494f-a211-d57cfcccac91 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:46.418239 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f1529-9ef8-494f-a211-d57cfcccac91 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:46.418594 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f1529-9ef8-494f-a211-d57cfcccac91 None admin] PATH_INFO: `/v3/groups/801a518589a7483396fdbdb796da45f6` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:46.419777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f1529-9ef8-494f-a211-d57cfcccac91 None admin] RBAC: Authorizing `identity:get_group(group_id=801a518589a7483396fdbdb796da45f6)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:46.422518 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f1529-9ef8-494f-a211-d57cfcccac91 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:46.422990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 226/454] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Jun 6 06:56:46 2022] GET /identity/v3/groups/801a518589a7483396fdbdb796da45f6 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:46.428914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5c412-21dd-4d3b-8724-8855083851ba None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:46.499484 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:46.533212 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5c412-21dd-4d3b-8724-8855083851ba None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:46.567706 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83599a8-8b67-4d36-928f-01e29b3b27d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:46.568364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83599a8-8b67-4d36-928f-01e29b3b27d2 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:46.568645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83599a8-8b67-4d36-928f-01e29b3b27d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:46.568919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83599a8-8b67-4d36-928f-01e29b3b27d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:46.569745 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83599a8-8b67-4d36-928f-01e29b3b27d2 None admin] RBAC: Adding query filter params (group.id=801a518589a7483396fdbdb796da45f6, role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=0d774be4b4f647c4aa73f115724f3d96) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:46.570064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83599a8-8b67-4d36-928f-01e29b3b27d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:46.571665 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83599a8-8b67-4d36-928f-01e29b3b27d2 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:46.578084 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 229/455] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Jun 6 06:56:46 2022] GET /identity/v3/role_assignments?group.id=801a518589a7483396fdbdb796da45f6&scope.project.id=0d774be4b4f647c4aa73f115724f3d96&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:49.369027 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5fa26-ac3f-4fec-a77b-b5f9d78b1d1b None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.369569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5fa26-ac3f-4fec-a77b-b5f9d78b1d1b None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.369569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5fa26-ac3f-4fec-a77b-b5f9d78b1d1b None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.371224 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 227/456] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:49.376954 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f589e-2661-48b2-a335-d7f45e71713d None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.378040 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f589e-2661-48b2-a335-d7f45e71713d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.378651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f589e-2661-48b2-a335-d7f45e71713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.403989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-ef4f589e-2661-48b2-a335-d7f45e71713d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:49.407504 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-ef4f589e-2661-48b2-a335-d7f45e71713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:49.441364 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc78f8e-72e3-4f83-88e7-fb55f117dc19 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.441670 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc78f8e-72e3-4f83-88e7-fb55f117dc19 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.441918 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc78f8e-72e3-4f83-88e7-fb55f117dc19 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.443884 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 228/457] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:49.449501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce9c03-05cf-4490-aecd-960ca58eb2a7 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.450063 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce9c03-05cf-4490-aecd-960ca58eb2a7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.450567 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce9c03-05cf-4490-aecd-960ca58eb2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.469837 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-85ce9c03-05cf-4490-aecd-960ca58eb2a7 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:49.472014 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-85ce9c03-05cf-4490-aecd-960ca58eb2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:49.512670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 230/458] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:49.512670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83bb4-01fa-4944-895d-109ce993ba78 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.512670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83bb4-01fa-4944-895d-109ce993ba78 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.512670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83bb4-01fa-4944-895d-109ce993ba78 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.512670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 231/459] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:49.518525 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82f50a-ed7c-429c-8ee8-c5a223ae1d68 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.518936 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82f50a-ed7c-429c-8ee8-c5a223ae1d68 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.519326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82f50a-ed7c-429c-8ee8-c5a223ae1d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.537371 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-1e82f50a-ed7c-429c-8ee8-c5a223ae1d68 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:49.538576 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-1e82f50a-ed7c-429c-8ee8-c5a223ae1d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:49.566395 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 229/460] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:49.566736 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce9c03-05cf-4490-aecd-960ca58eb2a7 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:49.580692 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:49.614173 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:49.630404 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 232/461] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:49.635251 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82f50a-ed7c-429c-8ee8-c5a223ae1d68 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:49.680714 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce9c03-05cf-4490-aecd-960ca58eb2a7 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:49.716626 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f995c2-5a16-4c01-b314-8e44f4d2914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:49.717423 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f995c2-5a16-4c01-b314-8e44f4d2914f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.717709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f995c2-5a16-4c01-b314-8e44f4d2914f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.717988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f995c2-5a16-4c01-b314-8e44f4d2914f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.729209 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f995c2-5a16-4c01-b314-8e44f4d2914f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:49.730695 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f995c2-5a16-4c01-b314-8e44f4d2914f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:49.744714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82f50a-ed7c-429c-8ee8-c5a223ae1d68 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-04f995c2-5a16-4c01-b314-8e44f4d2914f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:49.749508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:49.750635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:49.756723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:49.756723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:49.756723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:49.756723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:49.756723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 230/462] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:49.756723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f995c2-5a16-4c01-b314-8e44f4d2914f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:49.786312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12113021-5553-426c-a0b6-dbebca8029f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:49.787132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113021-5553-426c-a0b6-dbebca8029f2 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.787416 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113021-5553-426c-a0b6-dbebca8029f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.787700 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113021-5553-426c-a0b6-dbebca8029f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.799060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12113021-5553-426c-a0b6-dbebca8029f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:49.800525 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12113021-5553-426c-a0b6-dbebca8029f2 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:49.816908 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-12113021-5553-426c-a0b6-dbebca8029f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:49.819364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:49.820199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:49.825833 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:49.825833 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:49.825833 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:49.825833 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:49.825833 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 233/463] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:49.825833 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12113021-5553-426c-a0b6-dbebca8029f2 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:49.865912 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f995c2-5a16-4c01-b314-8e44f4d2914f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:49.871572 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:49.902013 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fdaaa-9561-444d-9284-817f56cd2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:49.902771 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fdaaa-9561-444d-9284-817f56cd2eec None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.903055 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fdaaa-9561-444d-9284-817f56cd2eec None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.903339 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fdaaa-9561-444d-9284-817f56cd2eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.915936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fdaaa-9561-444d-9284-817f56cd2eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:49.917824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fdaaa-9561-444d-9284-817f56cd2eec None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:49.931805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12113021-5553-426c-a0b6-dbebca8029f2 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-ae4fdaaa-9561-444d-9284-817f56cd2eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:49.935650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:49.936499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:49.937336 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:49.937336 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:49.937336 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:49.937336 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:49.937336 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 231/464] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:49.938056 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fdaaa-9561-444d-9284-817f56cd2eec None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:49.968601 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c49f09-3788-4ddc-a33e-c5f6210eb826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:49.969291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c49f09-3788-4ddc-a33e-c5f6210eb826 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.969580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c49f09-3788-4ddc-a33e-c5f6210eb826 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.969861 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c49f09-3788-4ddc-a33e-c5f6210eb826 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.970621 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c49f09-3788-4ddc-a33e-c5f6210eb826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:49.970933 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c49f09-3788-4ddc-a33e-c5f6210eb826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:49.972310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c49f09-3788-4ddc-a33e-c5f6210eb826 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:49.984364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 234/465] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:49.985566 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf336a7-0b9f-4b10-a87e-9e7d354a3b5a None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:49.985920 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf336a7-0b9f-4b10-a87e-9e7d354a3b5a None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:49.986153 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf336a7-0b9f-4b10-a87e-9e7d354a3b5a None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:49.987402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 235/466] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:49.988095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf336a7-0b9f-4b10-a87e-9e7d354a3b5a None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:50.041104 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fdaaa-9561-444d-9284-817f56cd2eec None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:50.053415 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:50.074788 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515f099-6554-4a9a-a5da-c266ec45d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:50.075607 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515f099-6554-4a9a-a5da-c266ec45d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:50.076218 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515f099-6554-4a9a-a5da-c266ec45d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:50.076505 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515f099-6554-4a9a-a5da-c266ec45d3d9 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:50.077242 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515f099-6554-4a9a-a5da-c266ec45d3d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:50.077562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515f099-6554-4a9a-a5da-c266ec45d3d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:50.078971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515f099-6554-4a9a-a5da-c266ec45d3d9 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:50.091034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf336a7-0b9f-4b10-a87e-9e7d354a3b5a None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:50.095587 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 232/467] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:50.095587 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515f099-6554-4a9a-a5da-c266ec45d3d9 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:50.095765 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:50.127632 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7f749-7ee0-4e5a-b7b6-3ddf90f7c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:50.128286 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7f749-7ee0-4e5a-b7b6-3ddf90f7c252 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:50.128568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7f749-7ee0-4e5a-b7b6-3ddf90f7c252 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:50.128844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7f749-7ee0-4e5a-b7b6-3ddf90f7c252 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:50.129558 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7f749-7ee0-4e5a-b7b6-3ddf90f7c252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:50.129863 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7f749-7ee0-4e5a-b7b6-3ddf90f7c252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:50.131265 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7f749-7ee0-4e5a-b7b6-3ddf90f7c252 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:50.142664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 236/468] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:50.143882 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc63b9-0cb6-4aef-bddb-3a361da93be0 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:50.144173 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc63b9-0cb6-4aef-bddb-3a361da93be0 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:50.144451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc63b9-0cb6-4aef-bddb-3a361da93be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:50.162373 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-e0fc63b9-0cb6-4aef-bddb-3a361da93be0 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:50.163511 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-e0fc63b9-0cb6-4aef-bddb-3a361da93be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:50.192498 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515f099-6554-4a9a-a5da-c266ec45d3d9 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:50.226514 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fdfca-33fa-44d8-816d-0a688e04d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:50.227198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fdfca-33fa-44d8-816d-0a688e04d4f5 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:50.227489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fdfca-33fa-44d8-816d-0a688e04d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:50.227767 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fdfca-33fa-44d8-816d-0a688e04d4f5 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:50.228478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fdfca-33fa-44d8-816d-0a688e04d4f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:50.229915 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fdfca-33fa-44d8-816d-0a688e04d4f5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:50.232324 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 237/469] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:50.233164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc63b9-0cb6-4aef-bddb-3a361da93be0 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:50.304188 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 233/470] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:56:50 2022] POST /identity/v3/users => generated 246 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:50.305156 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fdfca-33fa-44d8-816d-0a688e04d4f5 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:50.354562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:50.441937 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fdfca-33fa-44d8-816d-0a688e04d4f5 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:50.456896 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:50.465528 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc63b9-0cb6-4aef-bddb-3a361da93be0 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:50.481519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db0f73-2a7f-41b3-b107-92615469d069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:50.482204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db0f73-2a7f-41b3-b107-92615469d069 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:50.482566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db0f73-2a7f-41b3-b107-92615469d069 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:50.482852 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db0f73-2a7f-41b3-b107-92615469d069 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:50.483923 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db0f73-2a7f-41b3-b107-92615469d069 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:50.485403 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db0f73-2a7f-41b3-b107-92615469d069 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:50.508278 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2062b-a92d-4bcc-bd15-1db1aab0748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:50.508843 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2062b-a92d-4bcc-bd15-1db1aab0748c None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:50.509133 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2062b-a92d-4bcc-bd15-1db1aab0748c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:50.510080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2062b-a92d-4bcc-bd15-1db1aab0748c None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:50.510358 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2062b-a92d-4bcc-bd15-1db1aab0748c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:50.511582 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2062b-a92d-4bcc-bd15-1db1aab0748c None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:50.548750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 234/471] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:56:50 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:50.549593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db0f73-2a7f-41b3-b107-92615469d069 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:50.595721 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 238/472] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:56:50 2022] POST /identity/v3/users => generated 248 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:50.660690 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:50.682025 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db0f73-2a7f-41b3-b107-92615469d069 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:50.725093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcced19-da16-494a-92b2-2fe9151c0a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:50.726236 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcced19-da16-494a-92b2-2fe9151c0a6f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:50.726749 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcced19-da16-494a-92b2-2fe9151c0a6f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:50.727767 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcced19-da16-494a-92b2-2fe9151c0a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:50.740481 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcced19-da16-494a-92b2-2fe9151c0a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:50.742324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcced19-da16-494a-92b2-2fe9151c0a6f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-4fcced19-da16-494a-92b2-2fe9151c0a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:50.763897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:50.764817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:50.765661 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:50.765661 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:50.765661 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:50.765661 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:50.767699 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 235/473] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:50.773514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2062b-a92d-4bcc-bd15-1db1aab0748c None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:50.887262 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2062b-a92d-4bcc-bd15-1db1aab0748c None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:50.929325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72dbbf-7924-4e5f-9c98-6c64e9f31246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:50.930009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72dbbf-7924-4e5f-9c98-6c64e9f31246 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:50.930326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72dbbf-7924-4e5f-9c98-6c64e9f31246 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:50.930681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72dbbf-7924-4e5f-9c98-6c64e9f31246 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:50.931423 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72dbbf-7924-4e5f-9c98-6c64e9f31246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:50.931736 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72dbbf-7924-4e5f-9c98-6c64e9f31246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:50.933133 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72dbbf-7924-4e5f-9c98-6c64e9f31246 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:50.945819 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 239/474] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:50.951386 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcced19-da16-494a-92b2-2fe9151c0a6f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:51.057559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcced19-da16-494a-92b2-2fe9151c0a6f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:51.093555 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e28b7-4966-49d9-9aab-0da03e190a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:51.094235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e28b7-4966-49d9-9aab-0da03e190a2d None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:51.094556 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e28b7-4966-49d9-9aab-0da03e190a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:51.094840 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e28b7-4966-49d9-9aab-0da03e190a2d None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:51.095560 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e28b7-4966-49d9-9aab-0da03e190a2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:51.097004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e28b7-4966-49d9-9aab-0da03e190a2d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:51.104935 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:51.173357 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 236/475] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:56:50 2022] POST /identity/v3/users => generated 249 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:56:52.811006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f00b91-074a-4eb6-b771-122634180c58 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:52.811573 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f00b91-074a-4eb6-b771-122634180c58 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:52.811573 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f00b91-074a-4eb6-b771-122634180c58 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:52.813271 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 240/476] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:52.819579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1467e3-8a9d-4499-9413-d4437acc6b10 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:52.820573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1467e3-8a9d-4499-9413-d4437acc6b10 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:52.821088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1467e3-8a9d-4499-9413-d4437acc6b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:52.840291 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-fd1467e3-8a9d-4499-9413-d4437acc6b10 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:52.841851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-fd1467e3-8a9d-4499-9413-d4437acc6b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:52.916541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 237/477] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:52.941266 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f00b91-074a-4eb6-b771-122634180c58 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:52.955965 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:53.057286 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f00b91-074a-4eb6-b771-122634180c58 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:53.093316 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0a354-f3f8-492c-b0f2-c38513cd5c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:53.094120 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0a354-f3f8-492c-b0f2-c38513cd5c0d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.094435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0a354-f3f8-492c-b0f2-c38513cd5c0d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.094718 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0a354-f3f8-492c-b0f2-c38513cd5c0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.105204 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0a354-f3f8-492c-b0f2-c38513cd5c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-6fe0a354-f3f8-492c-b0f2-c38513cd5c0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:53.112890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:53.113754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:53.115023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 241/478] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:56:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:53.122033 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1467e3-8a9d-4499-9413-d4437acc6b10 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:53.199985 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656648a1-eb99-454c-840d-92a4605a2ba1 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.200305 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656648a1-eb99-454c-840d-92a4605a2ba1 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.200558 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656648a1-eb99-454c-840d-92a4605a2ba1 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.202186 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 242/479] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:53.207832 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5fec8-6e13-43d3-afd6-614ad9923912 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.208167 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5fec8-6e13-43d3-afd6-614ad9923912 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.208402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5fec8-6e13-43d3-afd6-614ad9923912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.227875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-36d5fec8-6e13-43d3-afd6-614ad9923912 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:53.229163 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-36d5fec8-6e13-43d3-afd6-614ad9923912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:53.234107 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1467e3-8a9d-4499-9413-d4437acc6b10 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:53.259659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:53.272726 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ac802-280a-4893-8b14-441842b1cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:53.273658 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ac802-280a-4893-8b14-441842b1cb4b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.274812 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ac802-280a-4893-8b14-441842b1cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.275689 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ac802-280a-4893-8b14-441842b1cb4b None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.276668 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ac802-280a-4893-8b14-441842b1cb4b None admin] RBAC: Adding query filter params (name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:53.277240 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ac802-280a-4893-8b14-441842b1cb4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:53.278847 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ac802-280a-4893-8b14-441842b1cb4b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:53.292470 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 238/480] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:53.294810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ac802-280a-4893-8b14-441842b1cb4b None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:53.297415 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:53.310408 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 243/481] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:53.327136 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc8cd-5e95-4efa-aa93-aeee538d4093 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.327429 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc8cd-5e95-4efa-aa93-aeee538d4093 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.327711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc8cd-5e95-4efa-aa93-aeee538d4093 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.329081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 244/482] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:56:53.333334 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bc8cd-5e95-4efa-aa93-aeee538d4093 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:53.411891 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ac802-280a-4893-8b14-441842b1cb4b None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:53.437186 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bc8cd-5e95-4efa-aa93-aeee538d4093 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:53.448858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fac846-7528-48cc-a624-3329b35cf1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:53.449892 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac846-7528-48cc-a624-3329b35cf1fe None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.450257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac846-7528-48cc-a624-3329b35cf1fe None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.450574 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac846-7528-48cc-a624-3329b35cf1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.461929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fac846-7528-48cc-a624-3329b35cf1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:53.463400 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fac846-7528-48cc-a624-3329b35cf1fe None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:53.474165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3966-ca72-47e9-8c4d-38224f41f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:53.474981 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3966-ca72-47e9-8c4d-38224f41f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.475262 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3966-ca72-47e9-8c4d-38224f41f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.475537 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3966-ca72-47e9-8c4d-38224f41f7b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-94fac846-7528-48cc-a624-3329b35cf1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:53.480809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:53.481651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:53.482634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:53.482634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:53.482634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:53.482634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:53.482634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 239/483] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:53.483373 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc75e-c431-47f4-992f-b54baa5f6c91 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.483470 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc75e-c431-47f4-992f-b54baa5f6c91 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.483738 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc75e-c431-47f4-992f-b54baa5f6c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.491774 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe3966-ca72-47e9-8c4d-38224f41f7b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:53.500526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-1b8cc75e-c431-47f4-992f-b54baa5f6c91 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-48fe3966-ca72-47e9-8c4d-38224f41f7b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:53.500666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:53.501498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:53.507164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:53.507761 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-1b8cc75e-c431-47f4-992f-b54baa5f6c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:53.507840 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 245/484] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:53.507840 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3966-ca72-47e9-8c4d-38224f41f7b5 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:53.536961 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:53.569188 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:53.578099 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 240/485] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:53.578978 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cc75e-c431-47f4-992f-b54baa5f6c91 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:53.610079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3966-ca72-47e9-8c4d-38224f41f7b5 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:53.644966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cbf04-38c0-4270-8701-6a34320933da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:53.645632 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cbf04-38c0-4270-8701-6a34320933da None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.645948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cbf04-38c0-4270-8701-6a34320933da None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.646289 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cbf04-38c0-4270-8701-6a34320933da None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.647069 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cbf04-38c0-4270-8701-6a34320933da None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:53.647376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cbf04-38c0-4270-8701-6a34320933da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:53.648752 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cbf04-38c0-4270-8701-6a34320933da None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:53.660394 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 246/486] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:53.661807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ec7f3-f559-4dde-9551-6b4d23f4ee17 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.662211 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ec7f3-f559-4dde-9551-6b4d23f4ee17 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.662533 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ec7f3-f559-4dde-9551-6b4d23f4ee17 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.666401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 247/487] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:53.666401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ec7f3-f559-4dde-9551-6b4d23f4ee17 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:53.679507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cc75e-c431-47f4-992f-b54baa5f6c91 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:53.713374 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c751f9b-6735-4020-9c50-39eb150743fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:53.714063 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c751f9b-6735-4020-9c50-39eb150743fc None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.714376 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c751f9b-6735-4020-9c50-39eb150743fc None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.714668 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c751f9b-6735-4020-9c50-39eb150743fc None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.715415 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c751f9b-6735-4020-9c50-39eb150743fc None admin] RBAC: Adding query filter params (name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:53.715727 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c751f9b-6735-4020-9c50-39eb150743fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:53.717172 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c751f9b-6735-4020-9c50-39eb150743fc None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:53.725503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 241/488] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:53.726408 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c751f9b-6735-4020-9c50-39eb150743fc None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:53.760332 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:53.767243 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ec7f3-f559-4dde-9551-6b4d23f4ee17 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:53.787240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:53.801618 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca615d03-fbca-45b9-8b08-e0f614067563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:53.802486 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca615d03-fbca-45b9-8b08-e0f614067563 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.802889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca615d03-fbca-45b9-8b08-e0f614067563 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.803173 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca615d03-fbca-45b9-8b08-e0f614067563 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.814358 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca615d03-fbca-45b9-8b08-e0f614067563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-ca615d03-fbca-45b9-8b08-e0f614067563 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:53.822226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:53.823360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 248/489] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:53.829293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0a0c4-fc7c-455d-ad63-00a2bf336553 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.830199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0a0c4-fc7c-455d-ad63-00a2bf336553 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.830199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0a0c4-fc7c-455d-ad63-00a2bf336553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.839498 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c751f9b-6735-4020-9c50-39eb150743fc None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:53.841768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-d4e0a0c4-fc7c-455d-ad63-00a2bf336553 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:53.842976 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-d4e0a0c4-fc7c-455d-ad63-00a2bf336553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:53.874154 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82978e85-a3c3-42d3-ab0b-a6a15bd8d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:53.874979 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82978e85-a3c3-42d3-ab0b-a6a15bd8d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:53.875271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82978e85-a3c3-42d3-ab0b-a6a15bd8d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:53.875552 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82978e85-a3c3-42d3-ab0b-a6a15bd8d1c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:53.883052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82978e85-a3c3-42d3-ab0b-a6a15bd8d1c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:53.884503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82978e85-a3c3-42d3-ab0b-a6a15bd8d1c3 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-82978e85-a3c3-42d3-ab0b-a6a15bd8d1c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:56:53.899792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:53.900823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 242/490] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jun 6 06:56:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:53.901932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82978e85-a3c3-42d3-ab0b-a6a15bd8d1c3 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:53.917758 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 249/491] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:53.918649 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0a0c4-fc7c-455d-ad63-00a2bf336553 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.017596 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.028844 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82978e85-a3c3-42d3-ab0b-a6a15bd8d1c3 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.059735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0a0c4-fc7c-455d-ad63-00a2bf336553 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.062809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc1b7d-732f-4d68-a721-fab5a9cbad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.063603 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc1b7d-732f-4d68-a721-fab5a9cbad6d None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.063896 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc1b7d-732f-4d68-a721-fab5a9cbad6d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.064179 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc1b7d-732f-4d68-a721-fab5a9cbad6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.070423 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.074279 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc1b7d-732f-4d68-a721-fab5a9cbad6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.075753 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc1b7d-732f-4d68-a721-fab5a9cbad6d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.092879 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0012e30-4b82-4c49-bb4b-fb62aed0b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-35bc1b7d-732f-4d68-a721-fab5a9cbad6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:54.093312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:54.094226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:54.095204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:54.095204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:54.095204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:54.095204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:54.095417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0012e30-4b82-4c49-bb4b-fb62aed0b42c None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.095417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0012e30-4b82-4c49-bb4b-fb62aed0b42c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.095417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0012e30-4b82-4c49-bb4b-fb62aed0b42c None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.095586 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 243/492] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:54.095665 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0012e30-4b82-4c49-bb4b-fb62aed0b42c None admin] RBAC: Adding query filter params (name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:54.095665 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0012e30-4b82-4c49-bb4b-fb62aed0b42c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.095783 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc1b7d-732f-4d68-a721-fab5a9cbad6d None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.096649 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0012e30-4b82-4c49-bb4b-fb62aed0b42c None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.105447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 250/493] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:54.106480 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0012e30-4b82-4c49-bb4b-fb62aed0b42c None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.198468 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc1b7d-732f-4d68-a721-fab5a9cbad6d None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.205232 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0012e30-4b82-4c49-bb4b-fb62aed0b42c None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.232031 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530e8cc-a180-4759-a823-995444e7b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.232699 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530e8cc-a180-4759-a823-995444e7b7bb None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.232984 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530e8cc-a180-4759-a823-995444e7b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.233264 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530e8cc-a180-4759-a823-995444e7b7bb None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.234091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530e8cc-a180-4759-a823-995444e7b7bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:54.234436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530e8cc-a180-4759-a823-995444e7b7bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.235875 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530e8cc-a180-4759-a823-995444e7b7bb None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.239389 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87dc20-47f5-462f-bfd0-55e3ee7493c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.240174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87dc20-47f5-462f-bfd0-55e3ee7493c6 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.240463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87dc20-47f5-462f-bfd0-55e3ee7493c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.240746 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87dc20-47f5-462f-bfd0-55e3ee7493c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.250764 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87dc20-47f5-462f-bfd0-55e3ee7493c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-6b87dc20-47f5-462f-bfd0-55e3ee7493c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:54.258808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:54.259699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:54.260505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 251/494] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:54.261154 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87dc20-47f5-462f-bfd0-55e3ee7493c6 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.262158 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.277309 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 244/495] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:54.278217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530e8cc-a180-4759-a823-995444e7b7bb None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.294173 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.362313 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87dc20-47f5-462f-bfd0-55e3ee7493c6 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.379503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530e8cc-a180-4759-a823-995444e7b7bb None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.394718 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e281e-7acc-48a9-9781-491d48415ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.395372 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e281e-7acc-48a9-9781-491d48415ca3 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.395654 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e281e-7acc-48a9-9781-491d48415ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.395930 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e281e-7acc-48a9-9781-491d48415ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.396647 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e281e-7acc-48a9-9781-491d48415ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:54.396950 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e281e-7acc-48a9-9781-491d48415ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.398323 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e281e-7acc-48a9-9781-491d48415ca3 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.410041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 252/496] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:54.410862 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e281e-7acc-48a9-9781-491d48415ca3 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.417910 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e3179-11c2-438c-9a0b-289a08a88852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.418791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e3179-11c2-438c-9a0b-289a08a88852 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.419085 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e3179-11c2-438c-9a0b-289a08a88852 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.419364 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e3179-11c2-438c-9a0b-289a08a88852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.429480 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e3179-11c2-438c-9a0b-289a08a88852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.430976 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e3179-11c2-438c-9a0b-289a08a88852 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-e53e3179-11c2-438c-9a0b-289a08a88852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:54.447953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:54.449035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:54.449932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:54.449932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:54.449932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:54.449932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:54.449932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 245/497] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:54.449932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e3179-11c2-438c-9a0b-289a08a88852 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.501336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.502966 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.510566 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e281e-7acc-48a9-9781-491d48415ca3 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.544061 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f04d29-0025-4594-a003-c42f8f6b36be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.544714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f04d29-0025-4594-a003-c42f8f6b36be None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.545000 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f04d29-0025-4594-a003-c42f8f6b36be None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.545280 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f04d29-0025-4594-a003-c42f8f6b36be None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.546021 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f04d29-0025-4594-a003-c42f8f6b36be None admin] RBAC: Adding query filter params (name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:54.546325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f04d29-0025-4594-a003-c42f8f6b36be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.547714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f04d29-0025-4594-a003-c42f8f6b36be None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.552125 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e3179-11c2-438c-9a0b-289a08a88852 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.555435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 253/498] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:54.556214 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f04d29-0025-4594-a003-c42f8f6b36be None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.585714 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e55b8-f1c6-462b-a8a9-0f40b2581f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.586441 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e55b8-f1c6-462b-a8a9-0f40b2581f85 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.586774 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e55b8-f1c6-462b-a8a9-0f40b2581f85 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.587077 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e55b8-f1c6-462b-a8a9-0f40b2581f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.653412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e55b8-f1c6-462b-a8a9-0f40b2581f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.654980 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e55b8-f1c6-462b-a8a9-0f40b2581f85 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.655129 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f04d29-0025-4594-a003-c42f8f6b36be None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.688256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24e3c2-67c7-449e-8582-099aa9b2488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.689030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24e3c2-67c7-449e-8582-099aa9b2488a None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.689312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24e3c2-67c7-449e-8582-099aa9b2488a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.689587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24e3c2-67c7-449e-8582-099aa9b2488a None admin] PATH_INFO: `/v3/users/glance` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.697340 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24e3c2-67c7-449e-8582-099aa9b2488a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.698784 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24e3c2-67c7-449e-8582-099aa9b2488a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.701842 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-8d24e3c2-67c7-449e-8582-099aa9b2488a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:56:54.714082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:54.715227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 254/499] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:54.716321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24e3c2-67c7-449e-8582-099aa9b2488a None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.733515 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.754595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 246/500] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:54.755440 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e55b8-f1c6-462b-a8a9-0f40b2581f85 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.815923 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24e3c2-67c7-449e-8582-099aa9b2488a None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.849679 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400378-03b8-4c30-ae2d-94998d02afbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.850359 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400378-03b8-4c30-ae2d-94998d02afbc None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.850654 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400378-03b8-4c30-ae2d-94998d02afbc None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.850937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400378-03b8-4c30-ae2d-94998d02afbc None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.851666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400378-03b8-4c30-ae2d-94998d02afbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:54.851979 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400378-03b8-4c30-ae2d-94998d02afbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.853410 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400378-03b8-4c30-ae2d-94998d02afbc None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.853767 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e55b8-f1c6-462b-a8a9-0f40b2581f85 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:54.864474 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 255/501] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:54.865261 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400378-03b8-4c30-ae2d-94998d02afbc None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.888988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0b2a5-50e5-47e2-b499-bda5a6cdce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:54.889772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b2a5-50e5-47e2-b499-bda5a6cdce11 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:54.890054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b2a5-50e5-47e2-b499-bda5a6cdce11 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:54.890344 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b2a5-50e5-47e2-b499-bda5a6cdce11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:54.900284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0b2a5-50e5-47e2-b499-bda5a6cdce11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:54.901586 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0b2a5-50e5-47e2-b499-bda5a6cdce11 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-f9d0b2a5-50e5-47e2-b499-bda5a6cdce11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:54.919096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:54.920091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:54.920956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:54.920956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:54.920956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:54.920956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:54.920956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 247/502] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:54.921215 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0b2a5-50e5-47e2-b499-bda5a6cdce11 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:54.923897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.946511 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:54.970602 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400378-03b8-4c30-ae2d-94998d02afbc None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.004191 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370723-93e1-4147-b53a-581fef485fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.004853 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370723-93e1-4147-b53a-581fef485fbf None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.005138 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370723-93e1-4147-b53a-581fef485fbf None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.005412 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370723-93e1-4147-b53a-581fef485fbf None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.006246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45370723-93e1-4147-b53a-581fef485fbf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:55.006589 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45370723-93e1-4147-b53a-581fef485fbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.008001 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45370723-93e1-4147-b53a-581fef485fbf None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.021594 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0b2a5-50e5-47e2-b499-bda5a6cdce11 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.043454 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 256/503] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:55.044260 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370723-93e1-4147-b53a-581fef485fbf None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.055006 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0061-f608-42f7-a7e7-d51cc6667a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.056308 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0061-f608-42f7-a7e7-d51cc6667a40 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.056594 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0061-f608-42f7-a7e7-d51cc6667a40 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.056872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0061-f608-42f7-a7e7-d51cc6667a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.067492 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e0061-f608-42f7-a7e7-d51cc6667a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.068942 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e0061-f608-42f7-a7e7-d51cc6667a40 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-790e0061-f608-42f7-a7e7-d51cc6667a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:55.086550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:55.088521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:55.090665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:55.090665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:55.090665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:55.090665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:55.090665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 248/504] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:55.090665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0061-f608-42f7-a7e7-d51cc6667a40 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.150028 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:55.155274 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370723-93e1-4147-b53a-581fef485fbf None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.183961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:55.188591 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958b2f1-754f-4803-a371-a4bb77b9c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.189382 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b2f1-754f-4803-a371-a4bb77b9c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.189667 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b2f1-754f-4803-a371-a4bb77b9c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.192339 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b2f1-754f-4803-a371-a4bb77b9c3d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.195529 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0061-f608-42f7-a7e7-d51cc6667a40 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.197374 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958b2f1-754f-4803-a371-a4bb77b9c3d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.198856 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958b2f1-754f-4803-a371-a4bb77b9c3d2 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-5958b2f1-754f-4803-a371-a4bb77b9c3d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:56:55.213477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:55.214587 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 06:56:55.215662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:55.219467 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 257/505] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:55.220294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958b2f1-754f-4803-a371-a4bb77b9c3d2 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.232545 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32374b9-e137-4c0b-9f73-b0fc6a8939d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.233152 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32374b9-e137-4c0b-9f73-b0fc6a8939d8 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.233439 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32374b9-e137-4c0b-9f73-b0fc6a8939d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.233739 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32374b9-e137-4c0b-9f73-b0fc6a8939d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.234478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32374b9-e137-4c0b-9f73-b0fc6a8939d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:55.234792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32374b9-e137-4c0b-9f73-b0fc6a8939d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.236158 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32374b9-e137-4c0b-9f73-b0fc6a8939d8 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.248312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 249/506] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:55.249099 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32374b9-e137-4c0b-9f73-b0fc6a8939d8 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.318228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958b2f1-754f-4803-a371-a4bb77b9c3d2 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.347261 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32374b9-e137-4c0b-9f73-b0fc6a8939d8 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.350770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e7675-02c8-4341-a0dc-20ccbabc3645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.351414 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e7675-02c8-4341-a0dc-20ccbabc3645 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.351702 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e7675-02c8-4341-a0dc-20ccbabc3645 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.351982 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e7675-02c8-4341-a0dc-20ccbabc3645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.361958 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:55.385017 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f6005-ecd9-497d-a99a-f035cda3a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.385689 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f6005-ecd9-497d-a99a-f035cda3a56a None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.385983 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f6005-ecd9-497d-a99a-f035cda3a56a None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.386264 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f6005-ecd9-497d-a99a-f035cda3a56a None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.387034 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f6005-ecd9-497d-a99a-f035cda3a56a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:55.387347 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f6005-ecd9-497d-a99a-f035cda3a56a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.388726 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f6005-ecd9-497d-a99a-f035cda3a56a None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.406368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 250/507] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:55.406368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f6005-ecd9-497d-a99a-f035cda3a56a None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.419260 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:55.429115 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e7675-02c8-4341-a0dc-20ccbabc3645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.431170 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e7675-02c8-4341-a0dc-20ccbabc3645 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.505889 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f6005-ecd9-497d-a99a-f035cda3a56a None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.528809 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 258/508] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:55.529650 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e7675-02c8-4341-a0dc-20ccbabc3645 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.542167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15a412-e0bd-427a-8ccd-21612ab2a565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.542860 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15a412-e0bd-427a-8ccd-21612ab2a565 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.543146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15a412-e0bd-427a-8ccd-21612ab2a565 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.543426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15a412-e0bd-427a-8ccd-21612ab2a565 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.544256 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15a412-e0bd-427a-8ccd-21612ab2a565 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:55.544564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15a412-e0bd-427a-8ccd-21612ab2a565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.545987 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15a412-e0bd-427a-8ccd-21612ab2a565 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.566731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 251/509] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:55.567361 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15a412-e0bd-427a-8ccd-21612ab2a565 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.596886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:55.622625 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:55.631349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e7675-02c8-4341-a0dc-20ccbabc3645 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.665899 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e08ff-1c5e-4b60-9e4e-e15683176728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.666107 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15a412-e0bd-427a-8ccd-21612ab2a565 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.666727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e08ff-1c5e-4b60-9e4e-e15683176728 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.667009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e08ff-1c5e-4b60-9e4e-e15683176728 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.667281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e08ff-1c5e-4b60-9e4e-e15683176728 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.674062 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e08ff-1c5e-4b60-9e4e-e15683176728 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.675834 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e08ff-1c5e-4b60-9e4e-e15683176728 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-4a7e08ff-1c5e-4b60-9e4e-e15683176728 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:56:55.689901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:55.690995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 259/510] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:55.692284 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e08ff-1c5e-4b60-9e4e-e15683176728 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.705035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12b15-3ce7-4ec2-9375-4fdc6889d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.705834 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12b15-3ce7-4ec2-9375-4fdc6889d082 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.706119 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12b15-3ce7-4ec2-9375-4fdc6889d082 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.706432 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12b15-3ce7-4ec2-9375-4fdc6889d082 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.713586 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb12b15-3ce7-4ec2-9375-4fdc6889d082 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.715060 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb12b15-3ce7-4ec2-9375-4fdc6889d082 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-7fb12b15-3ce7-4ec2-9375-4fdc6889d082 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:56:55.729504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:55.730314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:55.731211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:56:55.731211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:56:55.731211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:56:55.731211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:56:55.731211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:56:55.731211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:56:55.731211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:56:55.731211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:55.731211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 252/511] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:55.731683 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12b15-3ce7-4ec2-9375-4fdc6889d082 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.792967 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e08ff-1c5e-4b60-9e4e-e15683176728 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.823630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:55.825005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4f4e-a97e-4b00-89d4-31fb1e46785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.825805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4f4e-a97e-4b00-89d4-31fb1e46785d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.826093 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4f4e-a97e-4b00-89d4-31fb1e46785d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.826401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4f4e-a97e-4b00-89d4-31fb1e46785d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.832147 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12b15-3ce7-4ec2-9375-4fdc6889d082 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.837556 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4f4e-a97e-4b00-89d4-31fb1e46785d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.839047 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4f4e-a97e-4b00-89d4-31fb1e46785d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-42fc4f4e-a97e-4b00-89d4-31fb1e46785d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:55.856494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:55.857356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:55.858206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:55.858206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:55.858206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:55.858206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:55.858206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 260/512] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:55.858564 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4f4e-a97e-4b00-89d4-31fb1e46785d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:55.861968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:55.870806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd163a-fa97-42f3-b403-20c1c4bc2bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.873936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd163a-fa97-42f3-b403-20c1c4bc2bcc None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.873936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd163a-fa97-42f3-b403-20c1c4bc2bcc None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.873936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd163a-fa97-42f3-b403-20c1c4bc2bcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.942051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd163a-fa97-42f3-b403-20c1c4bc2bcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.943543 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd163a-fa97-42f3-b403-20c1c4bc2bcc None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:55.958588 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4f4e-a97e-4b00-89d4-31fb1e46785d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:55.993567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35bb19-063e-4c3a-8b94-c151d11d9308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:55.994238 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35bb19-063e-4c3a-8b94-c151d11d9308 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:55.994569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35bb19-063e-4c3a-8b94-c151d11d9308 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:55.994837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35bb19-063e-4c3a-8b94-c151d11d9308 None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:55.995676 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35bb19-063e-4c3a-8b94-c151d11d9308 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:55.995991 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35bb19-063e-4c3a-8b94-c151d11d9308 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:55.997419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35bb19-063e-4c3a-8b94-c151d11d9308 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.014763 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 261/513] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:56.015559 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35bb19-063e-4c3a-8b94-c151d11d9308 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.032991 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:56.042167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 253/514] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:56.044011 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd163a-fa97-42f3-b403-20c1c4bc2bcc None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.079985 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:56.117524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35bb19-063e-4c3a-8b94-c151d11d9308 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:56.139699 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd163a-fa97-42f3-b403-20c1c4bc2bcc None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:56.151338 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350f6d-294c-4448-a568-ebf8de426a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:56.151992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350f6d-294c-4448-a568-ebf8de426a60 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:56.152272 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350f6d-294c-4448-a568-ebf8de426a60 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:56.152550 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350f6d-294c-4448-a568-ebf8de426a60 None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:56.153333 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350f6d-294c-4448-a568-ebf8de426a60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:56.153638 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350f6d-294c-4448-a568-ebf8de426a60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:56.155091 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350f6d-294c-4448-a568-ebf8de426a60 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.171981 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 262/515] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:56.172772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9641b-6dc6-41e8-835d-e89863176a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:56.172914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350f6d-294c-4448-a568-ebf8de426a60 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.173426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9641b-6dc6-41e8-835d-e89863176a9b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:56.173714 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9641b-6dc6-41e8-835d-e89863176a9b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:56.173993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9641b-6dc6-41e8-835d-e89863176a9b None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:56.174740 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9641b-6dc6-41e8-835d-e89863176a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:56.175050 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9641b-6dc6-41e8-835d-e89863176a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:56.176410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9641b-6dc6-41e8-835d-e89863176a9b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.187560 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 254/516] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:56.188345 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9641b-6dc6-41e8-835d-e89863176a9b None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.243925 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:56.270635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350f6d-294c-4448-a568-ebf8de426a60 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:56.290561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9641b-6dc6-41e8-835d-e89863176a9b None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:56.294405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:56.306170 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b3ead-59b2-44eb-bea4-2dc6586d54dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:56.307011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b3ead-59b2-44eb-bea4-2dc6586d54dc None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:56.307338 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b3ead-59b2-44eb-bea4-2dc6586d54dc None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:56.307659 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b3ead-59b2-44eb-bea4-2dc6586d54dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:56.322970 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1689-f97a-4356-84bf-cf675aa358cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:56.323750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1689-f97a-4356-84bf-cf675aa358cb None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:56.324031 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1689-f97a-4356-84bf-cf675aa358cb None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:56.324306 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1689-f97a-4356-84bf-cf675aa358cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:56.334722 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a1689-f97a-4356-84bf-cf675aa358cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:56.336230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a1689-f97a-4356-84bf-cf675aa358cb None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-633a1689-f97a-4356-84bf-cf675aa358cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:56.353413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:56.354274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:56.355324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:56.355324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:56.355324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:56.355324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:56.355324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 255/517] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:56.355761 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1689-f97a-4356-84bf-cf675aa358cb None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.377814 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b3ead-59b2-44eb-bea4-2dc6586d54dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:56.379368 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b3ead-59b2-44eb-bea4-2dc6586d54dc None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.466438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1689-f97a-4356-84bf-cf675aa358cb None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:56.468845 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:56.495194 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 263/518] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:56:56.496104 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b3ead-59b2-44eb-bea4-2dc6586d54dc None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.505728 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5964c-474f-4b3e-aa72-2066bf0657b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:56.506787 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5964c-474f-4b3e-aa72-2066bf0657b0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:56.507293 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5964c-474f-4b3e-aa72-2066bf0657b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:56.508178 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5964c-474f-4b3e-aa72-2066bf0657b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:56.509663 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5964c-474f-4b3e-aa72-2066bf0657b0 None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=f446e118975f44b4b31511302a7af36e) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:56.509984 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5964c-474f-4b3e-aa72-2066bf0657b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:56.511504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5964c-474f-4b3e-aa72-2066bf0657b0 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.517302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 256/519] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/role_assignments?user.id=f446e118975f44b4b31511302a7af36e&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:56.518082 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5964c-474f-4b3e-aa72-2066bf0657b0 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.528824 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:56.618407 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b3ead-59b2-44eb-bea4-2dc6586d54dc None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:56.642117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5964c-474f-4b3e-aa72-2066bf0657b0 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:56.656215 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffdf89-5fc3-45c9-b7ce-f5184374186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:56.657166 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffdf89-5fc3-45c9-b7ce-f5184374186a None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:56.657494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffdf89-5fc3-45c9-b7ce-f5184374186a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:56.657803 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffdf89-5fc3-45c9-b7ce-f5184374186a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:56.665789 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffdf89-5fc3-45c9-b7ce-f5184374186a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:56.667331 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffdf89-5fc3-45c9-b7ce-f5184374186a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-23ffdf89-5fc3-45c9-b7ce-f5184374186a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:56:56.683681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:56.684799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:56.685889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:56:56.685889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:56:56.685889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:56:56.685889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:56:56.685889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:56:56.685889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:56:56.685889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:56:56.685889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:56.686449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f051f3-f921-4f66-979d-0a905c3e4260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:56.686449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f051f3-f921-4f66-979d-0a905c3e4260 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:56.686449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f051f3-f921-4f66-979d-0a905c3e4260 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:56.686449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f051f3-f921-4f66-979d-0a905c3e4260 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:56.686752 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f051f3-f921-4f66-979d-0a905c3e4260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:56.686752 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f051f3-f921-4f66-979d-0a905c3e4260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:56.687682 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f051f3-f921-4f66-979d-0a905c3e4260 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.688112 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 264/520] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:56.689026 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffdf89-5fc3-45c9-b7ce-f5184374186a None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.706344 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 257/521] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:56.706344 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f051f3-f921-4f66-979d-0a905c3e4260 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.734635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:56.785054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:56.806559 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffdf89-5fc3-45c9-b7ce-f5184374186a None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:56.819038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f051f3-f921-4f66-979d-0a905c3e4260 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:56.849531 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89cd89-3dac-433b-ba56-52e046b8fcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:56.850536 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89cd89-3dac-433b-ba56-52e046b8fcac None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:56.851080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89cd89-3dac-433b-ba56-52e046b8fcac None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:56.851270 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89cd89-3dac-433b-ba56-52e046b8fcac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:56.856858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a4d6-948f-4f74-976f-8b5472199cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:56.857606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a4d6-948f-4f74-976f-8b5472199cb4 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:56.857966 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a4d6-948f-4f74-976f-8b5472199cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:56.858318 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a4d6-948f-4f74-976f-8b5472199cb4 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:56.859637 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a4d6-948f-4f74-976f-8b5472199cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:56.860078 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a4d6-948f-4f74-976f-8b5472199cb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:56.862110 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a4d6-948f-4f74-976f-8b5472199cb4 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.863220 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89cd89-3dac-433b-ba56-52e046b8fcac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:56.864670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89cd89-3dac-433b-ba56-52e046b8fcac None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:56.885876 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 258/522] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:56.885876 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a4d6-948f-4f74-976f-8b5472199cb4 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-7e89cd89-3dac-433b-ba56-52e046b8fcac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:56.886463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:56.887370 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:56.888200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:56.888200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:56.888200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:56.888200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:56.888200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 265/523] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:56.888200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89cd89-3dac-433b-ba56-52e046b8fcac None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:56.987376 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:57.000979 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a4d6-948f-4f74-976f-8b5472199cb4 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:57.001644 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89cd89-3dac-433b-ba56-52e046b8fcac None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:57.038898 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14777f-6130-40bb-ad69-bfd86c2efc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:57.039249 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b9ffe-6ea7-4842-ba3d-4315983549ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:57.040569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14777f-6130-40bb-ad69-bfd86c2efc2f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:57.040700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b9ffe-6ea7-4842-ba3d-4315983549ea None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:57.040904 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b9ffe-6ea7-4842-ba3d-4315983549ea None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:57.041186 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b9ffe-6ea7-4842-ba3d-4315983549ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:57.041500 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14777f-6130-40bb-ad69-bfd86c2efc2f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:57.041945 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14777f-6130-40bb-ad69-bfd86c2efc2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:57.042998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14777f-6130-40bb-ad69-bfd86c2efc2f None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=b1618d2efb0c45f98a081126f5342abc) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:57.043313 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14777f-6130-40bb-ad69-bfd86c2efc2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:57.044746 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14777f-6130-40bb-ad69-bfd86c2efc2f None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:57.046878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:57.048218 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b9ffe-6ea7-4842-ba3d-4315983549ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:57.049658 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b9ffe-6ea7-4842-ba3d-4315983549ea None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:57.051568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 266/524] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/role_assignments?user.id=b1618d2efb0c45f98a081126f5342abc&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:57.052533 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14777f-6130-40bb-ad69-bfd86c2efc2f None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-bb2b9ffe-6ea7-4842-ba3d-4315983549ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:56:57.076108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:57.077127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:57.077962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:56:57.077962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:56:57.077962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:56:57.077962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:56:57.077962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:56:57.077962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:56:57.077962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:56:57.077962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:57.077962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 259/525] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:57.083760 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b9ffe-6ea7-4842-ba3d-4315983549ea None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:57.179592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14777f-6130-40bb-ad69-bfd86c2efc2f None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:57.219287 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de4970-5db5-4ee5-b926-8f768a32a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:57.220267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de4970-5db5-4ee5-b926-8f768a32a060 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:57.220753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de4970-5db5-4ee5-b926-8f768a32a060 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:57.221206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de4970-5db5-4ee5-b926-8f768a32a060 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:57.222224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de4970-5db5-4ee5-b926-8f768a32a060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:57.222541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b9ffe-6ea7-4842-ba3d-4315983549ea None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:57.222995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de4970-5db5-4ee5-b926-8f768a32a060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:57.224957 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de4970-5db5-4ee5-b926-8f768a32a060 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:57.243898 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 267/526] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:57.245145 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de4970-5db5-4ee5-b926-8f768a32a060 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:57.263824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8c37-806e-4ad0-a09d-ea9876e53ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:57.264603 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8c37-806e-4ad0-a09d-ea9876e53ca2 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:57.264941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8c37-806e-4ad0-a09d-ea9876e53ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:57.265193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8c37-806e-4ad0-a09d-ea9876e53ca2 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:57.266171 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f8c37-806e-4ad0-a09d-ea9876e53ca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:57.266593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f8c37-806e-4ad0-a09d-ea9876e53ca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:57.268102 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f8c37-806e-4ad0-a09d-ea9876e53ca2 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:57.283217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 260/527] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:57.291703 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8c37-806e-4ad0-a09d-ea9876e53ca2 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:57.309310 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:57.309588 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:57.367228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de4970-5db5-4ee5-b926-8f768a32a060 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:57.405745 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b94a81-a1bd-479a-8777-7e30014d7481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:57.406593 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94a81-a1bd-479a-8777-7e30014d7481 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:57.406886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94a81-a1bd-479a-8777-7e30014d7481 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:57.407169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94a81-a1bd-479a-8777-7e30014d7481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:57.409992 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8c37-806e-4ad0-a09d-ea9876e53ca2 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:57.415397 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b94a81-a1bd-479a-8777-7e30014d7481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:57.416873 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b94a81-a1bd-479a-8777-7e30014d7481 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-c5b94a81-a1bd-479a-8777-7e30014d7481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:56:57.432948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:57.433827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:57.434719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:56:57.434719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:56:57.434719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:56:57.434719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:56:57.434719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:56:57.434719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:56:57.434719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:56:57.434719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:57.438649 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 268/528] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:56:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:57.439828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b94a81-a1bd-479a-8777-7e30014d7481 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:57.449848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75c64e-e56f-42ae-a5da-6c48729822c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:57.450551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75c64e-e56f-42ae-a5da-6c48729822c3 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:57.450840 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75c64e-e56f-42ae-a5da-6c48729822c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:57.451123 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75c64e-e56f-42ae-a5da-6c48729822c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:57.452410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75c64e-e56f-42ae-a5da-6c48729822c3 None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=1c3429d0ba28474698c6c168270d314b) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:57.453116 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75c64e-e56f-42ae-a5da-6c48729822c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:57.454878 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75c64e-e56f-42ae-a5da-6c48729822c3 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:57.463228 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 261/529] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:57 2022] GET /identity/v3/role_assignments?user.id=1c3429d0ba28474698c6c168270d314b&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:57.566821 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b94a81-a1bd-479a-8777-7e30014d7481 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:57.591044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:57.607036 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1063624-da75-4709-836b-7887b93e56b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:57.607729 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063624-da75-4709-836b-7887b93e56b7 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:57.608030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063624-da75-4709-836b-7887b93e56b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:57.608319 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063624-da75-4709-836b-7887b93e56b7 None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:57.609137 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1063624-da75-4709-836b-7887b93e56b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:57.609457 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1063624-da75-4709-836b-7887b93e56b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:57.611073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1063624-da75-4709-836b-7887b93e56b7 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:57.625190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 269/530] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:57.635534 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75c64e-e56f-42ae-a5da-6c48729822c3 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:57.718562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:57.749146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75c64e-e56f-42ae-a5da-6c48729822c3 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:57.785609 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f14d2-f28b-4a22-a07b-da4709aaabfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:57.786274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f14d2-f28b-4a22-a07b-da4709aaabfa None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:57.786594 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f14d2-f28b-4a22-a07b-da4709aaabfa None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:57.786874 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f14d2-f28b-4a22-a07b-da4709aaabfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:57.787715 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f14d2-f28b-4a22-a07b-da4709aaabfa None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=77904d1264284c29b2d0b73831dd4096) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:57.788065 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f14d2-f28b-4a22-a07b-da4709aaabfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:57.789506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f14d2-f28b-4a22-a07b-da4709aaabfa None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:57.795828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 262/531] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:56:57 2022] GET /identity/v3/role_assignments?user.id=77904d1264284c29b2d0b73831dd4096&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:58.933403 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd816f8-48cd-4853-9d04-a51bd0f06273 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:58.933963 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd816f8-48cd-4853-9d04-a51bd0f06273 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:58.933963 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd816f8-48cd-4853-9d04-a51bd0f06273 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:58.935638 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 270/532] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:58.941448 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2352-2a9c-4efb-a9f9-22f02f83dc4b None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:58.942367 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2352-2a9c-4efb-a9f9-22f02f83dc4b None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:58.942872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2352-2a9c-4efb-a9f9-22f02f83dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:58.960605 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-4b8e2352-2a9c-4efb-a9f9-22f02f83dc4b None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:58.962723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-4b8e2352-2a9c-4efb-a9f9-22f02f83dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:59.037498 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 263/533] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:56:59.061065 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd816f8-48cd-4853-9d04-a51bd0f06273 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:59.179303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd816f8-48cd-4853-9d04-a51bd0f06273 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:59.215076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527408d4-603a-4e22-8e19-89dce85ba64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:59.215875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527408d4-603a-4e22-8e19-89dce85ba64f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.216159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527408d4-603a-4e22-8e19-89dce85ba64f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.216505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527408d4-603a-4e22-8e19-89dce85ba64f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.226712 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527408d4-603a-4e22-8e19-89dce85ba64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-527408d4-603a-4e22-8e19-89dce85ba64f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:59.234673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:59.235627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:59.236876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 271/534] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:56:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:59.243634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e2352-2a9c-4efb-a9f9-22f02f83dc4b None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:59.310033 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:59.353305 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e2352-2a9c-4efb-a9f9-22f02f83dc4b None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:59.393967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393da9-86e1-4c9f-806b-a503c31c2379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:59.394711 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393da9-86e1-4c9f-806b-a503c31c2379 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.394997 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393da9-86e1-4c9f-806b-a503c31c2379 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.395278 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393da9-86e1-4c9f-806b-a503c31c2379 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.396050 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c393da9-86e1-4c9f-806b-a503c31c2379 None admin] RBAC: Adding query filter params (name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:59.396357 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c393da9-86e1-4c9f-806b-a503c31c2379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:59.397741 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c393da9-86e1-4c9f-806b-a503c31c2379 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:59.407053 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 264/535] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:56:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:56:59.415662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527408d4-603a-4e22-8e19-89dce85ba64f None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:59.440221 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92a22-60d3-45d3-82e1-9855577d9a25 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.440512 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92a22-60d3-45d3-82e1-9855577d9a25 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.440712 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92a22-60d3-45d3-82e1-9855577d9a25 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.442243 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 265/536] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:59.447693 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ad28-cff1-4fdf-9037-69d84f35b1fc None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.447990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ad28-cff1-4fdf-9037-69d84f35b1fc None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.448277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ad28-cff1-4fdf-9037-69d84f35b1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.465367 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:59.471359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-f874ad28-cff1-4fdf-9037-69d84f35b1fc None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:56:59.472559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-f874ad28-cff1-4fdf-9037-69d84f35b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:56:59.528544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527408d4-603a-4e22-8e19-89dce85ba64f None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:59.545232 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 266/537] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:56:59.564768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdefcde-6168-4306-aa88-9a6155ae1d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:59.566199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdefcde-6168-4306-aa88-9a6155ae1d89 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.566793 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdefcde-6168-4306-aa88-9a6155ae1d89 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.567321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdefcde-6168-4306-aa88-9a6155ae1d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.569327 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ad28-cff1-4fdf-9037-69d84f35b1fc None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:59.581374 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdefcde-6168-4306-aa88-9a6155ae1d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:59.582948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdefcde-6168-4306-aa88-9a6155ae1d89 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-3cdefcde-6168-4306-aa88-9a6155ae1d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:56:59.606493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:59.609128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:59.611126 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:56:59.611126 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:56:59.611126 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:56:59.611126 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:59.611126 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 272/538] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:56:59.615873 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdefcde-6168-4306-aa88-9a6155ae1d89 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:59.639811 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:59.679043 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ad28-cff1-4fdf-9037-69d84f35b1fc None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:59.714261 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea2c40-9758-4dec-8617-3e3015f33a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:59.715188 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea2c40-9758-4dec-8617-3e3015f33a44 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.715539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea2c40-9758-4dec-8617-3e3015f33a44 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.715791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:59.715941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea2c40-9758-4dec-8617-3e3015f33a44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.725657 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdefcde-6168-4306-aa88-9a6155ae1d89 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:59.727831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea2c40-9758-4dec-8617-3e3015f33a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-ceea2c40-9758-4dec-8617-3e3015f33a44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:56:59.735750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:59.737635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:56:59.740131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:56:59.745901 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 267/539] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:56:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:59.745901 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea2c40-9758-4dec-8617-3e3015f33a44 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:59.766316 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b579ab-03a0-4b0d-98ec-77d07d20b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:59.768903 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b579ab-03a0-4b0d-98ec-77d07d20b329 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.770212 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b579ab-03a0-4b0d-98ec-77d07d20b329 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.771397 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b579ab-03a0-4b0d-98ec-77d07d20b329 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.772006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b579ab-03a0-4b0d-98ec-77d07d20b329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:59.772313 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b579ab-03a0-4b0d-98ec-77d07d20b329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:59.776291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b579ab-03a0-4b0d-98ec-77d07d20b329 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:59.793178 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 273/540] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:59.799609 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b579ab-03a0-4b0d-98ec-77d07d20b329 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:59.874000 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea2c40-9758-4dec-8617-3e3015f33a44 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:59.893150 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:56:59.911389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af2984-f4f5-4634-a1eb-ecd0e66419db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:59.912442 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af2984-f4f5-4634-a1eb-ecd0e66419db None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.912934 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af2984-f4f5-4634-a1eb-ecd0e66419db None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.913394 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af2984-f4f5-4634-a1eb-ecd0e66419db None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.914441 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af2984-f4f5-4634-a1eb-ecd0e66419db None admin] RBAC: Adding query filter params (name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:56:59.915069 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af2984-f4f5-4634-a1eb-ecd0e66419db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:59.916634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af2984-f4f5-4634-a1eb-ecd0e66419db None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:59.916816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b579ab-03a0-4b0d-98ec-77d07d20b329 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:56:59.934262 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 268/541] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:56:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:56:59.935526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af2984-f4f5-4634-a1eb-ecd0e66419db None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:56:59.953790 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab4dbc-9099-40b8-ba76-703d6bdab429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:56:59.955851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab4dbc-9099-40b8-ba76-703d6bdab429 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.955851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab4dbc-9099-40b8-ba76-703d6bdab429 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.955851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab4dbc-9099-40b8-ba76-703d6bdab429 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.963569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab4dbc-9099-40b8-ba76-703d6bdab429 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:56:59.965455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab4dbc-9099-40b8-ba76-703d6bdab429 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-1bab4dbc-9099-40b8-ba76-703d6bdab429 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:56:59.979944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:56:59.982671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:56:59.985935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 274/542] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jun 6 06:56:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:56:59.987551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eac36d-851e-4326-acc4-3183ecd0d512 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:56:59.987551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eac36d-851e-4326-acc4-3183ecd0d512 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:56:59.988207 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eac36d-851e-4326-acc4-3183ecd0d512 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:56:59.990385 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 275/543] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:56:59.990385 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eac36d-851e-4326-acc4-3183ecd0d512 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.022628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:00.046063 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af2984-f4f5-4634-a1eb-ecd0e66419db None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.082174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494f968-bafe-4725-88d1-faa510c57de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.083009 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f968-bafe-4725-88d1-faa510c57de4 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.083297 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f968-bafe-4725-88d1-faa510c57de4 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.083582 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f968-bafe-4725-88d1-faa510c57de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.095171 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494f968-bafe-4725-88d1-faa510c57de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:00.096647 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494f968-bafe-4725-88d1-faa510c57de4 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:00.099949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eac36d-851e-4326-acc4-3183ecd0d512 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-f494f968-bafe-4725-88d1-faa510c57de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:00.114266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:00.115177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:00.116038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:00.116038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:00.116038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:00.116038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:00.116038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 269/544] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:00.116684 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7769eec-fe4b-4eaa-9533-2fb76025f618 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.116967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7769eec-fe4b-4eaa-9533-2fb76025f618 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.117243 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7769eec-fe4b-4eaa-9533-2fb76025f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.135042 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-f7769eec-fe4b-4eaa-9533-2fb76025f618 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:00.136228 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-f7769eec-fe4b-4eaa-9533-2fb76025f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:00.142006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9e96c-2a20-432c-b82f-48cbe0a76194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.142711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9e96c-2a20-432c-b82f-48cbe0a76194 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.142994 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9e96c-2a20-432c-b82f-48cbe0a76194 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.143267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9e96c-2a20-432c-b82f-48cbe0a76194 None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.144105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9e96c-2a20-432c-b82f-48cbe0a76194 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:00.144413 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9e96c-2a20-432c-b82f-48cbe0a76194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:00.145837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9e96c-2a20-432c-b82f-48cbe0a76194 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:00.162564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:00.168724 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 276/545] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jun 6 06:56:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:00.169700 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9e96c-2a20-432c-b82f-48cbe0a76194 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.210935 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 270/546] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:00.211807 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7769eec-fe4b-4eaa-9533-2fb76025f618 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.236325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:00.270234 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9e96c-2a20-432c-b82f-48cbe0a76194 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.304820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0513311-571b-467c-8367-3ae7f4d6c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.306015 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513311-571b-467c-8367-3ae7f4d6c14e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.306300 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513311-571b-467c-8367-3ae7f4d6c14e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.306614 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513311-571b-467c-8367-3ae7f4d6c14e None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.307336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0513311-571b-467c-8367-3ae7f4d6c14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:00.307645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0513311-571b-467c-8367-3ae7f4d6c14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:00.309020 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0513311-571b-467c-8367-3ae7f4d6c14e None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:00.311271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7769eec-fe4b-4eaa-9533-2fb76025f618 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.320345 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 277/547] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:00.322428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d3cd-de6c-4882-ae21-2afd0f77a6b3 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.322622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d3cd-de6c-4882-ae21-2afd0f77a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.322906 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d3cd-de6c-4882-ae21-2afd0f77a6b3 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.326439 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 278/548] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:00.326439 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833d3cd-de6c-4882-ae21-2afd0f77a6b3 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.346720 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c228-939e-4594-9722-a672542f8e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.347515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c228-939e-4594-9722-a672542f8e54 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.347797 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c228-939e-4594-9722-a672542f8e54 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.348074 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c228-939e-4594-9722-a672542f8e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.357868 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124c228-939e-4594-9722-a672542f8e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:00.359327 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124c228-939e-4594-9722-a672542f8e54 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-4124c228-939e-4594-9722-a672542f8e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:00.376818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:00.378117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:00.379191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:00.379191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:00.379191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:00.379191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:00.379191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 271/549] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:00.379191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c228-939e-4594-9722-a672542f8e54 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.394028 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:00.443179 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833d3cd-de6c-4882-ae21-2afd0f77a6b3 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.471404 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:00.479401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bebfaf-fc28-4f62-b6ef-67842d61e565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.480200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bebfaf-fc28-4f62-b6ef-67842d61e565 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.480487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bebfaf-fc28-4f62-b6ef-67842d61e565 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.480761 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bebfaf-fc28-4f62-b6ef-67842d61e565 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.480919 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c228-939e-4594-9722-a672542f8e54 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.491324 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bebfaf-fc28-4f62-b6ef-67842d61e565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-13bebfaf-fc28-4f62-b6ef-67842d61e565 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:57:00.498944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:00.499805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:00.501085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 279/550] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:00.501920 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391bdf7-f03e-4bab-a8f7-1eac48e995d2 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.501920 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391bdf7-f03e-4bab-a8f7-1eac48e995d2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.501920 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391bdf7-f03e-4bab-a8f7-1eac48e995d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.519599 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-a391bdf7-f03e-4bab-a8f7-1eac48e995d2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:00.520145 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b7f9-d3c8-40e6-af60-47d0471a5c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.520795 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-a391bdf7-f03e-4bab-a8f7-1eac48e995d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:00.520943 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b7f9-d3c8-40e6-af60-47d0471a5c07 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.521233 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b7f9-d3c8-40e6-af60-47d0471a5c07 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.521509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b7f9-d3c8-40e6-af60-47d0471a5c07 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.529628 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636b7f9-d3c8-40e6-af60-47d0471a5c07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:00.531158 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636b7f9-d3c8-40e6-af60-47d0471a5c07 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-a636b7f9-d3c8-40e6-af60-47d0471a5c07 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:00.547833 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:00.548851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 272/551] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:00.549777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b7f9-d3c8-40e6-af60-47d0471a5c07 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.595551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 280/552] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:00.596402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391bdf7-f03e-4bab-a8f7-1eac48e995d2 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.629194 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:00.654421 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b7f9-d3c8-40e6-af60-47d0471a5c07 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.688462 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e428a4b-9401-4106-9c3b-a3e5eccad719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.689120 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e428a4b-9401-4106-9c3b-a3e5eccad719 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.689404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e428a4b-9401-4106-9c3b-a3e5eccad719 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.689693 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e428a4b-9401-4106-9c3b-a3e5eccad719 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.690502 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e428a4b-9401-4106-9c3b-a3e5eccad719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:00.690746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e428a4b-9401-4106-9c3b-a3e5eccad719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:00.692122 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e428a4b-9401-4106-9c3b-a3e5eccad719 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:00.704349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 273/553] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:00.705340 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e428a4b-9401-4106-9c3b-a3e5eccad719 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.706949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391bdf7-f03e-4bab-a8f7-1eac48e995d2 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.730907 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:00.750377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154ac70-ae73-4c35-828a-22d911804558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.751048 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ac70-ae73-4c35-828a-22d911804558 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.751335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ac70-ae73-4c35-828a-22d911804558 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.751614 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ac70-ae73-4c35-828a-22d911804558 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.752383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154ac70-ae73-4c35-828a-22d911804558 None admin] RBAC: Adding query filter params (name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:00.752959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154ac70-ae73-4c35-828a-22d911804558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:00.754355 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154ac70-ae73-4c35-828a-22d911804558 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:00.763336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 281/554] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:00.764142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154ac70-ae73-4c35-828a-22d911804558 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.811667 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e428a4b-9401-4106-9c3b-a3e5eccad719 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.845893 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa148-6241-4a48-b1d7-8a38fc4df617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.846665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa148-6241-4a48-b1d7-8a38fc4df617 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.846951 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa148-6241-4a48-b1d7-8a38fc4df617 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.847228 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa148-6241-4a48-b1d7-8a38fc4df617 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.848057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defa148-6241-4a48-b1d7-8a38fc4df617 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:00.848367 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defa148-6241-4a48-b1d7-8a38fc4df617 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:00.849812 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defa148-6241-4a48-b1d7-8a38fc4df617 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:00.851429 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:00.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 274/555] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:00.868172 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa148-6241-4a48-b1d7-8a38fc4df617 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.869550 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154ac70-ae73-4c35-828a-22d911804558 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:00.904120 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471c231-ad52-4eb5-9388-0d6eece69317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:00.904917 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471c231-ad52-4eb5-9388-0d6eece69317 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:00.905202 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471c231-ad52-4eb5-9388-0d6eece69317 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:00.905477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471c231-ad52-4eb5-9388-0d6eece69317 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:00.918649 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471c231-ad52-4eb5-9388-0d6eece69317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-a471c231-ad52-4eb5-9388-0d6eece69317 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:57:00.926524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:00.927636 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 282/556] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:00.928732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471c231-ad52-4eb5-9388-0d6eece69317 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:00.973793 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:00.976718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa148-6241-4a48-b1d7-8a38fc4df617 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.011482 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f415a-9c11-42cf-94ba-f856c25aeb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.012211 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f415a-9c11-42cf-94ba-f856c25aeb7f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.012501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f415a-9c11-42cf-94ba-f856c25aeb7f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.012782 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f415a-9c11-42cf-94ba-f856c25aeb7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.019388 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f415a-9c11-42cf-94ba-f856c25aeb7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.020841 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f415a-9c11-42cf-94ba-f856c25aeb7f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.031466 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471c231-ad52-4eb5-9388-0d6eece69317 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-a55f415a-9c11-42cf-94ba-f856c25aeb7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:01.034391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:01.035359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:01.036277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:01.036277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:01.036277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:01.036277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:01.036277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:01.036277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:01.036277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:01.036277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:01.036277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 275/557] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:01.036774 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f415a-9c11-42cf-94ba-f856c25aeb7f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.078283 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a0f56-d117-4905-bf4d-5ba9f588946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.079097 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0f56-d117-4905-bf4d-5ba9f588946e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.079383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0f56-d117-4905-bf4d-5ba9f588946e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.079658 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0f56-d117-4905-bf4d-5ba9f588946e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.090187 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0f56-d117-4905-bf4d-5ba9f588946e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.091525 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:01.091993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0f56-d117-4905-bf4d-5ba9f588946e None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-cd9a0f56-d117-4905-bf4d-5ba9f588946e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:01.108518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:01.110041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:01.111165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:01.111165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:01.111165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:01.111165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:01.114398 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 283/558] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:01.115249 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a0f56-d117-4905-bf4d-5ba9f588946e None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.139419 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f415a-9c11-42cf-94ba-f856c25aeb7f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.171508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de61a56-98ac-4af6-b330-9c7ba78a885c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.172326 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de61a56-98ac-4af6-b330-9c7ba78a885c None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.172618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de61a56-98ac-4af6-b330-9c7ba78a885c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.172897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de61a56-98ac-4af6-b330-9c7ba78a885c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.183990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de61a56-98ac-4af6-b330-9c7ba78a885c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.185452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de61a56-98ac-4af6-b330-9c7ba78a885c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-2de61a56-98ac-4af6-b330-9c7ba78a885c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:01.202804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:01.203861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:01.205054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:01.205054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:01.205054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:01.205054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:01.205054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 276/559] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:01.205054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de61a56-98ac-4af6-b330-9c7ba78a885c None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.205770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:01.217939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a0f56-d117-4905-bf4d-5ba9f588946e None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.255261 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcefdc5-b422-415d-b15c-a4fea1e2c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.255925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcefdc5-b422-415d-b15c-a4fea1e2c280 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.256207 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcefdc5-b422-415d-b15c-a4fea1e2c280 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.256484 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcefdc5-b422-415d-b15c-a4fea1e2c280 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.257229 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcefdc5-b422-415d-b15c-a4fea1e2c280 None admin] RBAC: Adding query filter params (name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:01.257535 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcefdc5-b422-415d-b15c-a4fea1e2c280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.259485 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcefdc5-b422-415d-b15c-a4fea1e2c280 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.267359 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 284/560] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:01.268072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcefdc5-b422-415d-b15c-a4fea1e2c280 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.304981 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de61a56-98ac-4af6-b330-9c7ba78a885c None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.307817 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:01.339896 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cf62b-c53c-4dd1-a395-9c4cd6dc4238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.340580 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cf62b-c53c-4dd1-a395-9c4cd6dc4238 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.340870 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cf62b-c53c-4dd1-a395-9c4cd6dc4238 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.341151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cf62b-c53c-4dd1-a395-9c4cd6dc4238 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.341935 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cf62b-c53c-4dd1-a395-9c4cd6dc4238 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:01.342248 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cf62b-c53c-4dd1-a395-9c4cd6dc4238 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.343713 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cf62b-c53c-4dd1-a395-9c4cd6dc4238 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.355702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 277/561] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:01.356505 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cf62b-c53c-4dd1-a395-9c4cd6dc4238 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.364439 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcefdc5-b422-415d-b15c-a4fea1e2c280 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.397623 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a64ee9-0787-4068-8e95-b9a22b701993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.398283 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a64ee9-0787-4068-8e95-b9a22b701993 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.398628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a64ee9-0787-4068-8e95-b9a22b701993 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.398914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a64ee9-0787-4068-8e95-b9a22b701993 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.399641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a64ee9-0787-4068-8e95-b9a22b701993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:01.399951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a64ee9-0787-4068-8e95-b9a22b701993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.401322 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a64ee9-0787-4068-8e95-b9a22b701993 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.412866 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 285/562] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:01.413648 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a64ee9-0787-4068-8e95-b9a22b701993 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.432490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:01.457444 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cf62b-c53c-4dd1-a395-9c4cd6dc4238 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.493490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad46e0a-b6dd-4a51-9e34-181cd5691ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.494143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad46e0a-b6dd-4a51-9e34-181cd5691ad8 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.494467 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad46e0a-b6dd-4a51-9e34-181cd5691ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.494746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad46e0a-b6dd-4a51-9e34-181cd5691ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.495469 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad46e0a-b6dd-4a51-9e34-181cd5691ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:01.495778 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad46e0a-b6dd-4a51-9e34-181cd5691ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.497145 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad46e0a-b6dd-4a51-9e34-181cd5691ad8 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.509140 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 278/563] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:01.509977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad46e0a-b6dd-4a51-9e34-181cd5691ad8 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.520279 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a64ee9-0787-4068-8e95-b9a22b701993 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.534448 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:01.553671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce652fae-3b3f-4dac-bdf1-2c2347a72869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.554496 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce652fae-3b3f-4dac-bdf1-2c2347a72869 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.554776 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce652fae-3b3f-4dac-bdf1-2c2347a72869 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.555048 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce652fae-3b3f-4dac-bdf1-2c2347a72869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.565500 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce652fae-3b3f-4dac-bdf1-2c2347a72869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.566982 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce652fae-3b3f-4dac-bdf1-2c2347a72869 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-ce652fae-3b3f-4dac-bdf1-2c2347a72869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:01.584028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:01.585100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:01.586203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:01.586203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:01.586203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:01.586203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:01.586203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 286/564] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:01.586203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce652fae-3b3f-4dac-bdf1-2c2347a72869 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.611975 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad46e0a-b6dd-4a51-9e34-181cd5691ad8 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.652189 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e07c0-476e-40f9-875e-cdef4e66170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.653093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e07c0-476e-40f9-875e-cdef4e66170f None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.653372 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e07c0-476e-40f9-875e-cdef4e66170f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.653646 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e07c0-476e-40f9-875e-cdef4e66170f None admin] PATH_INFO: `/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/f446e118975f44b4b31511302a7af36e/roles/cc89d9147f55445ca2cf0a2345259c43` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.658184 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:01.669810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e07c0-476e-40f9-875e-cdef4e66170f None admin] RBAC: Authorizing `identity:create_grant(project_id=518ead35f9cb42f7b67bbe66e16c3236, user_id=f446e118975f44b4b31511302a7af36e, role_id=cc89d9147f55445ca2cf0a2345259c43)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.671319 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e07c0-476e-40f9-875e-cdef4e66170f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.697183 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce652fae-3b3f-4dac-bdf1-2c2347a72869 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.731485 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaeaa0-3e9c-46a1-bc3e-b284dd83ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.732263 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaeaa0-3e9c-46a1-bc3e-b284dd83ef52 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.732544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaeaa0-3e9c-46a1-bc3e-b284dd83ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.732816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaeaa0-3e9c-46a1-bc3e-b284dd83ef52 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.739730 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaeaa0-3e9c-46a1-bc3e-b284dd83ef52 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.741164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaeaa0-3e9c-46a1-bc3e-b284dd83ef52 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-cfdaeaa0-3e9c-46a1-bc3e-b284dd83ef52 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:01.756006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:01.761447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 287/565] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:01.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaeaa0-3e9c-46a1-bc3e-b284dd83ef52 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.765076 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 279/566] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:57:01 2022] PUT /identity/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/f446e118975f44b4b31511302a7af36e/roles/cc89d9147f55445ca2cf0a2345259c43 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:57:01.766022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e07c0-476e-40f9-875e-cdef4e66170f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.872956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:01.874951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaeaa0-3e9c-46a1-bc3e-b284dd83ef52 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.904268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:01.904626 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e07c0-476e-40f9-875e-cdef4e66170f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:01.918099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2ad99-ec86-436e-91fd-09580f64f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.919365 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2ad99-ec86-436e-91fd-09580f64f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.919365 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2ad99-ec86-436e-91fd-09580f64f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.919696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2ad99-ec86-436e-91fd-09580f64f0a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.927526 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2ad99-ec86-436e-91fd-09580f64f0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.929018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2ad99-ec86-436e-91fd-09580f64f0a5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-82a2ad99-ec86-436e-91fd-09580f64f0a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:01.943826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:01.944983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:01.945949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:01.945949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:01.945949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:01.945949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:01.945949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:01.945949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:01.945949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:01.945949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:01.945949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 288/567] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:01.946523 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2ad99-ec86-436e-91fd-09580f64f0a5 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:01.953146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4ddb-d1aa-461c-8e76-411194f28f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:01.953908 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4ddb-d1aa-461c-8e76-411194f28f12 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:01.954751 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4ddb-d1aa-461c-8e76-411194f28f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:01.955030 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4ddb-d1aa-461c-8e76-411194f28f12 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:01.960517 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4ddb-d1aa-461c-8e76-411194f28f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:01.960517 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4ddb-d1aa-461c-8e76-411194f28f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:01.960517 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4ddb-d1aa-461c-8e76-411194f28f12 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:01.974585 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 280/568] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:01.975786 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4ddb-d1aa-461c-8e76-411194f28f12 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.064262 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2ad99-ec86-436e-91fd-09580f64f0a5 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.082200 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4ddb-d1aa-461c-8e76-411194f28f12 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.099361 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16c648-3caa-4141-977a-806e271dbc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.100268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16c648-3caa-4141-977a-806e271dbc39 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.100774 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16c648-3caa-4141-977a-806e271dbc39 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.101055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16c648-3caa-4141-977a-806e271dbc39 None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.101922 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16c648-3caa-4141-977a-806e271dbc39 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:02.102795 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16c648-3caa-4141-977a-806e271dbc39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.104231 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16c648-3caa-4141-977a-806e271dbc39 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.119389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9e6bc-c86e-4ca5-be7c-832bb0e98a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.120056 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9e6bc-c86e-4ca5-be7c-832bb0e98a87 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.120345 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9e6bc-c86e-4ca5-be7c-832bb0e98a87 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.120626 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9e6bc-c86e-4ca5-be7c-832bb0e98a87 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.121417 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9e6bc-c86e-4ca5-be7c-832bb0e98a87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:02.121732 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9e6bc-c86e-4ca5-be7c-832bb0e98a87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.126807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 289/569] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:02.126807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16c648-3caa-4141-977a-806e271dbc39 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.127004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9e6bc-c86e-4ca5-be7c-832bb0e98a87 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.127004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:02.144332 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 281/570] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:02.144332 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9e6bc-c86e-4ca5-be7c-832bb0e98a87 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.176036 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:02.231920 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16c648-3caa-4141-977a-806e271dbc39 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.246734 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9e6bc-c86e-4ca5-be7c-832bb0e98a87 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.267506 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b172d8-3f1f-4bcc-a340-5d6d75bd19b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.268622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b172d8-3f1f-4bcc-a340-5d6d75bd19b2 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.268914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b172d8-3f1f-4bcc-a340-5d6d75bd19b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.269197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b172d8-3f1f-4bcc-a340-5d6d75bd19b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.276899 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b172d8-3f1f-4bcc-a340-5d6d75bd19b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.278360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b172d8-3f1f-4bcc-a340-5d6d75bd19b2 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.287782 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd65421-e03c-4b2d-813a-5bd7eac34930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.288577 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd65421-e03c-4b2d-813a-5bd7eac34930 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.288862 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd65421-e03c-4b2d-813a-5bd7eac34930 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.289138 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd65421-e03c-4b2d-813a-5bd7eac34930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-86b172d8-3f1f-4bcc-a340-5d6d75bd19b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:02.293495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:02.294543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:02.295483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 290/571] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:57:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:02.296090 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b172d8-3f1f-4bcc-a340-5d6d75bd19b2 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.304864 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd65421-e03c-4b2d-813a-5bd7eac34930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.306893 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd65421-e03c-4b2d-813a-5bd7eac34930 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-4fd65421-e03c-4b2d-813a-5bd7eac34930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:02.324459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:02.325385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:02.326285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:02.326285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:02.326285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:02.326285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:02.326285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 282/572] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:02.326584 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd65421-e03c-4b2d-813a-5bd7eac34930 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.374467 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:02.408812 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b172d8-3f1f-4bcc-a340-5d6d75bd19b2 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.412347 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:02.431617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd65421-e03c-4b2d-813a-5bd7eac34930 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.446144 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c8044-f758-4bff-b36d-764cf8243e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.447067 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c8044-f758-4bff-b36d-764cf8243e61 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.447350 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c8044-f758-4bff-b36d-764cf8243e61 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.447627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c8044-f758-4bff-b36d-764cf8243e61 None admin] PATH_INFO: `/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/b1618d2efb0c45f98a081126f5342abc/roles/cc89d9147f55445ca2cf0a2345259c43` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.462848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c8044-f758-4bff-b36d-764cf8243e61 None admin] RBAC: Authorizing `identity:create_grant(project_id=518ead35f9cb42f7b67bbe66e16c3236, user_id=b1618d2efb0c45f98a081126f5342abc, role_id=cc89d9147f55445ca2cf0a2345259c43)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.464288 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c8044-f758-4bff-b36d-764cf8243e61 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.468392 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46d78-02a7-4469-b2b7-64320289cee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.469015 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46d78-02a7-4469-b2b7-64320289cee7 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.469311 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46d78-02a7-4469-b2b7-64320289cee7 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.469592 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46d78-02a7-4469-b2b7-64320289cee7 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.470461 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46d78-02a7-4469-b2b7-64320289cee7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:02.470777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46d78-02a7-4469-b2b7-64320289cee7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.472233 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46d78-02a7-4469-b2b7-64320289cee7 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.492849 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 283/573] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Jun 6 06:57:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:02.493500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46d78-02a7-4469-b2b7-64320289cee7 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.530363 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 291/574] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:57:02 2022] PUT /identity/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/b1618d2efb0c45f98a081126f5342abc/roles/cc89d9147f55445ca2cf0a2345259c43 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:57:02.530363 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c8044-f758-4bff-b36d-764cf8243e61 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.634889 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46d78-02a7-4469-b2b7-64320289cee7 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.638424 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:02.657859 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c8044-f758-4bff-b36d-764cf8243e61 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.686405 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf6767-1843-4ac5-b34a-2bee11b17f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.686986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf6767-1843-4ac5-b34a-2bee11b17f33 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.687274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf6767-1843-4ac5-b34a-2bee11b17f33 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.687536 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf6767-1843-4ac5-b34a-2bee11b17f33 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.688317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf6767-1843-4ac5-b34a-2bee11b17f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:02.688797 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf6767-1843-4ac5-b34a-2bee11b17f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.690427 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf6767-1843-4ac5-b34a-2bee11b17f33 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.711997 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 284/575] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:02.713079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf6767-1843-4ac5-b34a-2bee11b17f33 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.714137 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405690b-d10d-4900-8628-c4c7994e88c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.715307 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405690b-d10d-4900-8628-c4c7994e88c4 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.715931 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405690b-d10d-4900-8628-c4c7994e88c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.716440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405690b-d10d-4900-8628-c4c7994e88c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.730038 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405690b-d10d-4900-8628-c4c7994e88c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.732081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405690b-d10d-4900-8628-c4c7994e88c4 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-0405690b-d10d-4900-8628-c4c7994e88c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:02.754291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:02.755268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:02.756944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:02.756944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:02.756944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:02.756944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:02.756944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 292/576] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:02.763274 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405690b-d10d-4900-8628-c4c7994e88c4 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.773738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:02.836088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf6767-1843-4ac5-b34a-2bee11b17f33 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.874596 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d462c76-2ddf-4188-a14d-e148e8d0d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.876045 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d462c76-2ddf-4188-a14d-e148e8d0d215 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.876550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d462c76-2ddf-4188-a14d-e148e8d0d215 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.877108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d462c76-2ddf-4188-a14d-e148e8d0d215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.885762 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d462c76-2ddf-4188-a14d-e148e8d0d215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.887813 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d462c76-2ddf-4188-a14d-e148e8d0d215 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.893236 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405690b-d10d-4900-8628-c4c7994e88c4 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-4d462c76-2ddf-4188-a14d-e148e8d0d215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:02.904260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:02.905204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:02.906083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:02.906083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:02.906083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:02.906083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:02.906083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:02.906083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:02.906083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:02.906083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:02.915824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 285/577] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:02.926783 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d462c76-2ddf-4188-a14d-e148e8d0d215 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:02.938521 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a35ac-5db0-49c3-809c-7b0f1bb2affe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:02.939135 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a35ac-5db0-49c3-809c-7b0f1bb2affe None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:02.939423 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a35ac-5db0-49c3-809c-7b0f1bb2affe None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:02.939705 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a35ac-5db0-49c3-809c-7b0f1bb2affe None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:02.940438 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a35ac-5db0-49c3-809c-7b0f1bb2affe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:02.940746 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a35ac-5db0-49c3-809c-7b0f1bb2affe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:02.942714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a35ac-5db0-49c3-809c-7b0f1bb2affe None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:02.958573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:02.961931 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 293/578] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:02.962889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a35ac-5db0-49c3-809c-7b0f1bb2affe None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:03.030392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:03.045622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d462c76-2ddf-4188-a14d-e148e8d0d215 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:03.066410 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a35ac-5db0-49c3-809c-7b0f1bb2affe None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:03.088015 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845304-26ef-4378-a353-183c00a551f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:03.089044 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845304-26ef-4378-a353-183c00a551f2 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:03.089637 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845304-26ef-4378-a353-183c00a551f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:03.090238 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845304-26ef-4378-a353-183c00a551f2 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:03.091250 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e845304-26ef-4378-a353-183c00a551f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:03.091571 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e845304-26ef-4378-a353-183c00a551f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:03.093004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e845304-26ef-4378-a353-183c00a551f2 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:03.107111 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd485a05-464c-45cc-824b-9d60b7ccc32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:03.108196 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd485a05-464c-45cc-824b-9d60b7ccc32d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:03.108703 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd485a05-464c-45cc-824b-9d60b7ccc32d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:03.109176 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd485a05-464c-45cc-824b-9d60b7ccc32d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:03.109898 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 286/579] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:03.110757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845304-26ef-4378-a353-183c00a551f2 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:03.119181 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd485a05-464c-45cc-824b-9d60b7ccc32d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:03.121599 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd485a05-464c-45cc-824b-9d60b7ccc32d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-fd485a05-464c-45cc-824b-9d60b7ccc32d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:03.141772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:03.142820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:03.143754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:03.143754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:03.143754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:03.143754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:03.143754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:03.143754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:03.143754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:03.143754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:03.146688 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 294/580] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:03.149910 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd485a05-464c-45cc-824b-9d60b7ccc32d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:03.204256 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:03.221681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845304-26ef-4378-a353-183c00a551f2 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:03.260397 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313a3e1-f014-493b-8337-fdee7de97a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:03.261708 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a3e1-f014-493b-8337-fdee7de97a11 None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:03.262221 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a3e1-f014-493b-8337-fdee7de97a11 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:03.262766 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a3e1-f014-493b-8337-fdee7de97a11 None admin] PATH_INFO: `/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/1c3429d0ba28474698c6c168270d314b/roles/cc89d9147f55445ca2cf0a2345259c43` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:03.276362 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd485a05-464c-45cc-824b-9d60b7ccc32d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:03.279608 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313a3e1-f014-493b-8337-fdee7de97a11 None admin] RBAC: Authorizing `identity:create_grant(project_id=518ead35f9cb42f7b67bbe66e16c3236, user_id=1c3429d0ba28474698c6c168270d314b, role_id=cc89d9147f55445ca2cf0a2345259c43)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:03.281319 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313a3e1-f014-493b-8337-fdee7de97a11 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:03.304168 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:03.312736 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c94ad-8c86-4848-ba96-69d418afc7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:03.314495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c94ad-8c86-4848-ba96-69d418afc7d5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:03.314495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c94ad-8c86-4848-ba96-69d418afc7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:03.314495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c94ad-8c86-4848-ba96-69d418afc7d5 None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:03.314861 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c94ad-8c86-4848-ba96-69d418afc7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:03.315128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c94ad-8c86-4848-ba96-69d418afc7d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:03.316544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c94ad-8c86-4848-ba96-69d418afc7d5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:03.328672 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 295/581] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:03.334078 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c94ad-8c86-4848-ba96-69d418afc7d5 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:03.380313 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 287/582] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:57:03 2022] PUT /identity/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/1c3429d0ba28474698c6c168270d314b/roles/cc89d9147f55445ca2cf0a2345259c43 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:57:03.451113 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c94ad-8c86-4848-ba96-69d418afc7d5 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:03.493288 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf67e9-6c6b-484d-8c97-2b3f05648047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:03.494215 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf67e9-6c6b-484d-8c97-2b3f05648047 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:03.494535 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf67e9-6c6b-484d-8c97-2b3f05648047 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:03.494815 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf67e9-6c6b-484d-8c97-2b3f05648047 None admin] PATH_INFO: `/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/77904d1264284c29b2d0b73831dd4096/roles/cc89d9147f55445ca2cf0a2345259c43` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:03.512608 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf67e9-6c6b-484d-8c97-2b3f05648047 None admin] RBAC: Authorizing `identity:create_grant(project_id=518ead35f9cb42f7b67bbe66e16c3236, user_id=77904d1264284c29b2d0b73831dd4096, role_id=cc89d9147f55445ca2cf0a2345259c43)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:03.514078 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf67e9-6c6b-484d-8c97-2b3f05648047 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:03.586568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 296/583] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:57:03 2022] PUT /identity/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/77904d1264284c29b2d0b73831dd4096/roles/cc89d9147f55445ca2cf0a2345259c43 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 06:57:04.180283 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929e89d-14db-41c9-81db-30762e26f919 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:04.180472 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929e89d-14db-41c9-81db-30762e26f919 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:04.180759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929e89d-14db-41c9-81db-30762e26f919 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:04.182438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 288/584] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:04.187867 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605056-f3d7-4148-85e0-3b4fd177a667 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:04.188326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605056-f3d7-4148-85e0-3b4fd177a667 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:04.188617 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605056-f3d7-4148-85e0-3b4fd177a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:04.207580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-30605056-f3d7-4148-85e0-3b4fd177a667 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:04.208767 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-30605056-f3d7-4148-85e0-3b4fd177a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:04.240411 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:04.286645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 297/585] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:57:04.309385 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929e89d-14db-41c9-81db-30762e26f919 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:04.422991 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929e89d-14db-41c9-81db-30762e26f919 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:04.458715 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5037b-bfce-43ba-a6d4-b5d81a724a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:04.459452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5037b-bfce-43ba-a6d4-b5d81a724a07 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:04.459737 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5037b-bfce-43ba-a6d4-b5d81a724a07 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:04.460014 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5037b-bfce-43ba-a6d4-b5d81a724a07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:04.463330 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:04.477815 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5037b-bfce-43ba-a6d4-b5d81a724a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-31e5037b-bfce-43ba-a6d4-b5d81a724a07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:57:04.485694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:04.486648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:04.487501 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 289/586] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:57:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:04.493532 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605056-f3d7-4148-85e0-3b4fd177a667 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:04.608689 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605056-f3d7-4148-85e0-3b4fd177a667 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:04.647493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e7a1-ea1d-466f-8a4f-6e7105c6a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:04.648189 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e7a1-ea1d-466f-8a4f-6e7105c6a950 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:04.648446 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e7a1-ea1d-466f-8a4f-6e7105c6a950 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:04.648725 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e7a1-ea1d-466f-8a4f-6e7105c6a950 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:04.650153 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9e7a1-ea1d-466f-8a4f-6e7105c6a950 None admin] RBAC: Adding query filter params (name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:04.650509 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9e7a1-ea1d-466f-8a4f-6e7105c6a950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:04.651900 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9e7a1-ea1d-466f-8a4f-6e7105c6a950 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:04.665528 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 298/587] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:57:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:04.666937 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5037b-bfce-43ba-a6d4-b5d81a724a07 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:04.775031 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5037b-bfce-43ba-a6d4-b5d81a724a07 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:04.811707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1d0ff-63d2-4224-953a-26f26bb8d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:04.812500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1d0ff-63d2-4224-953a-26f26bb8d843 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:04.812781 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1d0ff-63d2-4224-953a-26f26bb8d843 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:04.813056 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1d0ff-63d2-4224-953a-26f26bb8d843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:04.825590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1d0ff-63d2-4224-953a-26f26bb8d843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:04.827084 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1d0ff-63d2-4224-953a-26f26bb8d843 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-72c1d0ff-63d2-4224-953a-26f26bb8d843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:04.844746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:04.846820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:04.848866 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:04.848866 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:04.848866 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:04.848866 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:04.848866 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 290/588] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:04.851918 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e7a1-ea1d-466f-8a4f-6e7105c6a950 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:04.883331 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:04.944351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f320e92-2dd8-438f-be21-36db54da5b08 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:04.944710 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f320e92-2dd8-438f-be21-36db54da5b08 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:04.944999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f320e92-2dd8-438f-be21-36db54da5b08 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:04.946498 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 291/589] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:04.955626 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77aec7-a7da-4348-a3c6-c73c1499d162 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:04.955924 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77aec7-a7da-4348-a3c6-c73c1499d162 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:04.956274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77aec7-a7da-4348-a3c6-c73c1499d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:04.977834 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e7a1-ea1d-466f-8a4f-6e7105c6a950 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:04.983710 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-3d77aec7-a7da-4348-a3c6-c73c1499d162 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:04.983710 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-3d77aec7-a7da-4348-a3c6-c73c1499d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:05.017506 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956851b-8e1b-471c-9adb-ca80f9122f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:05.018171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956851b-8e1b-471c-9adb-ca80f9122f71 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.018505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956851b-8e1b-471c-9adb-ca80f9122f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.018788 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956851b-8e1b-471c-9adb-ca80f9122f71 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.019514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956851b-8e1b-471c-9adb-ca80f9122f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:05.019826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956851b-8e1b-471c-9adb-ca80f9122f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:05.021326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956851b-8e1b-471c-9adb-ca80f9122f71 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:05.035675 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 299/590] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:05.040871 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:05.043066 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956851b-8e1b-471c-9adb-ca80f9122f71 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:05.071766 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 292/591] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:05.097066 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77aec7-a7da-4348-a3c6-c73c1499d162 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:05.150966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:05.163464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956851b-8e1b-471c-9adb-ca80f9122f71 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:05.208329 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafa39e-b029-43f6-98bb-1db981af5e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:05.210060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa39e-b029-43f6-98bb-1db981af5e21 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.210793 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa39e-b029-43f6-98bb-1db981af5e21 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.211231 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa39e-b029-43f6-98bb-1db981af5e21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.223571 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafa39e-b029-43f6-98bb-1db981af5e21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:05.225908 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafa39e-b029-43f6-98bb-1db981af5e21 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:05.229097 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77aec7-a7da-4348-a3c6-c73c1499d162 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-1aafa39e-b029-43f6-98bb-1db981af5e21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:05.246393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:05.247684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:57:05.248848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:05.251738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 300/592] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jun 6 06:57:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:05.259457 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafa39e-b029-43f6-98bb-1db981af5e21 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:05.274594 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c16f-2013-436d-ae75-540ba4c1a4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:05.277467 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c16f-2013-436d-ae75-540ba4c1a4ca None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.277467 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c16f-2013-436d-ae75-540ba4c1a4ca None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.277467 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c16f-2013-436d-ae75-540ba4c1a4ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.291636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5c16f-2013-436d-ae75-540ba4c1a4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-46f5c16f-2013-436d-ae75-540ba4c1a4ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:57:05.302804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:05.310903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:05.311963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:05.313592 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 293/593] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:57:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:05.314671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c16f-2013-436d-ae75-540ba4c1a4ca None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:05.363503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:05.389008 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafa39e-b029-43f6-98bb-1db981af5e21 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:05.439488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd275e-19d7-4bd3-847d-174248108a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:05.440414 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd275e-19d7-4bd3-847d-174248108a1c None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.440793 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c16f-2013-436d-ae75-540ba4c1a4ca None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:05.441047 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd275e-19d7-4bd3-847d-174248108a1c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.441492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd275e-19d7-4bd3-847d-174248108a1c None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.442785 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd275e-19d7-4bd3-847d-174248108a1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:05.443258 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd275e-19d7-4bd3-847d-174248108a1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:05.445867 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd275e-19d7-4bd3-847d-174248108a1c None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:05.475233 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 301/594] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jun 6 06:57:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:05.476820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd275e-19d7-4bd3-847d-174248108a1c None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:05.487961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:05.493448 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653115-a5bb-4532-9b88-eaba933be1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:05.494668 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653115-a5bb-4532-9b88-eaba933be1e6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.495111 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653115-a5bb-4532-9b88-eaba933be1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.500321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653115-a5bb-4532-9b88-eaba933be1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.500321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58653115-a5bb-4532-9b88-eaba933be1e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:05.500321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58653115-a5bb-4532-9b88-eaba933be1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:05.500321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58653115-a5bb-4532-9b88-eaba933be1e6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:05.515519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 294/595] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:57:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:05.516557 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653115-a5bb-4532-9b88-eaba933be1e6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:05.596581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd275e-19d7-4bd3-847d-174248108a1c None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:05.634156 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417134d8-489b-4927-9de6-51b30b7481da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:05.634939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417134d8-489b-4927-9de6-51b30b7481da None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.635223 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417134d8-489b-4927-9de6-51b30b7481da None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.635501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417134d8-489b-4927-9de6-51b30b7481da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.647433 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:05.652863 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653115-a5bb-4532-9b88-eaba933be1e6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:05.700995 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877baab7-9d52-4261-be5c-3e940ff033c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:05.701759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877baab7-9d52-4261-be5c-3e940ff033c0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.702051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877baab7-9d52-4261-be5c-3e940ff033c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.702352 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877baab7-9d52-4261-be5c-3e940ff033c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.716612 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877baab7-9d52-4261-be5c-3e940ff033c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:05.719287 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877baab7-9d52-4261-be5c-3e940ff033c0 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:05.733393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417134d8-489b-4927-9de6-51b30b7481da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:05.735214 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417134d8-489b-4927-9de6-51b30b7481da None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-877baab7-9d52-4261-be5c-3e940ff033c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:05.738792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:05.739664 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:05.740566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:05.740566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:05.740566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:05.740566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:05.745314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 295/596] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:05.746805 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877baab7-9d52-4261-be5c-3e940ff033c0 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:05.747357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:05.860309 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 302/597] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:57:05.860797 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877baab7-9d52-4261-be5c-3e940ff033c0 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:05.865809 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e900ef-147d-451a-beea-992137d7f9e9 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.866108 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e900ef-147d-451a-beea-992137d7f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.866565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e900ef-147d-451a-beea-992137d7f9e9 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.868528 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 303/598] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:05.869144 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e900ef-147d-451a-beea-992137d7f9e9 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:05.901169 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffd5d2-1637-472e-97a0-c6f98845adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:05.901949 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffd5d2-1637-472e-97a0-c6f98845adf6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.902266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffd5d2-1637-472e-97a0-c6f98845adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.902570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffd5d2-1637-472e-97a0-c6f98845adf6 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.903272 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffd5d2-1637-472e-97a0-c6f98845adf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:05.903586 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffd5d2-1637-472e-97a0-c6f98845adf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:05.904955 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffd5d2-1637-472e-97a0-c6f98845adf6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:05.923588 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 296/599] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:05.923588 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6fba1-2a6c-475b-84ae-197971e318e1 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:05.923588 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6fba1-2a6c-475b-84ae-197971e318e1 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:05.923588 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6fba1-2a6c-475b-84ae-197971e318e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:05.944656 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-e8b6fba1-2a6c-475b-84ae-197971e318e1 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:05.946372 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-e8b6fba1-2a6c-475b-84ae-197971e318e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:05.949485 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:05.978383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e900ef-147d-451a-beea-992137d7f9e9 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:05.986672 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:06.013794 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1874eeb-1e70-4958-a0cf-6d1e77762e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.014615 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1874eeb-1e70-4958-a0cf-6d1e77762e04 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.014901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1874eeb-1e70-4958-a0cf-6d1e77762e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.015226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1874eeb-1e70-4958-a0cf-6d1e77762e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.017887 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 297/600] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:06.018873 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6fba1-2a6c-475b-84ae-197971e318e1 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.026390 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1874eeb-1e70-4958-a0cf-6d1e77762e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:06.027982 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1874eeb-1e70-4958-a0cf-6d1e77762e04 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-c1874eeb-1e70-4958-a0cf-6d1e77762e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:06.046079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:06.047060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:06.052800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:06.052800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:06.052800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:06.052800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:06.052800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 304/601] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:06.052800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85dead-5511-4aa0-b0d0-accf747ec864 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.052800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85dead-5511-4aa0-b0d0-accf747ec864 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.052800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85dead-5511-4aa0-b0d0-accf747ec864 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.052800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 305/602] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:06.053310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85dead-5511-4aa0-b0d0-accf747ec864 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.119058 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6fba1-2a6c-475b-84ae-197971e318e1 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.152828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062558-0eb0-43c4-ba32-987b0e1a66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.153626 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062558-0eb0-43c4-ba32-987b0e1a66aa None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.153911 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062558-0eb0-43c4-ba32-987b0e1a66aa None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.154199 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062558-0eb0-43c4-ba32-987b0e1a66aa None admin] PATH_INFO: `/v3/users/glance` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.154886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85dead-5511-4aa0-b0d0-accf747ec864 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.161162 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f062558-0eb0-43c4-ba32-987b0e1a66aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:06.162647 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f062558-0eb0-43c4-ba32-987b0e1a66aa None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:06.165127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-3f062558-0eb0-43c4-ba32-987b0e1a66aa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:06.177198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:06.184257 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 298/603] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:06.185219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062558-0eb0-43c4-ba32-987b0e1a66aa None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.189616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f977d43-7bde-4787-943a-2f81d9f2530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.190431 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977d43-7bde-4787-943a-2f81d9f2530e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.190715 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977d43-7bde-4787-943a-2f81d9f2530e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.191022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977d43-7bde-4787-943a-2f81d9f2530e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.202228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f977d43-7bde-4787-943a-2f81d9f2530e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-8f977d43-7bde-4787-943a-2f81d9f2530e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:57:06.210076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:06.211786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 306/604] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:06.212881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e357-365c-49ea-939b-4aebd28638bd None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.213642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e357-365c-49ea-939b-4aebd28638bd None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.213642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e357-365c-49ea-939b-4aebd28638bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.229027 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-3aa7e357-365c-49ea-939b-4aebd28638bd None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:06.230210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-3aa7e357-365c-49ea-939b-4aebd28638bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:06.243675 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:06.282766 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062558-0eb0-43c4-ba32-987b0e1a66aa None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.296208 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 307/605] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:06.297041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7e357-365c-49ea-939b-4aebd28638bd None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.319512 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57d1c-90c6-47a0-851e-b580ec4f0ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.320457 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57d1c-90c6-47a0-851e-b580ec4f0ec5 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.321319 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57d1c-90c6-47a0-851e-b580ec4f0ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.321597 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57d1c-90c6-47a0-851e-b580ec4f0ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.322348 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57d1c-90c6-47a0-851e-b580ec4f0ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:06.322671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57d1c-90c6-47a0-851e-b580ec4f0ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:06.324050 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da57d1c-90c6-47a0-851e-b580ec4f0ec5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:06.335375 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 299/606] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:06.336168 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57d1c-90c6-47a0-851e-b580ec4f0ec5 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.395122 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:06.397787 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7e357-365c-49ea-939b-4aebd28638bd None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.431941 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36572d-c663-4e61-af97-1549116d4ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.432605 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36572d-c663-4e61-af97-1549116d4ebb None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.432893 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36572d-c663-4e61-af97-1549116d4ebb None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.433166 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36572d-c663-4e61-af97-1549116d4ebb None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.434004 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36572d-c663-4e61-af97-1549116d4ebb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:06.434321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36572d-c663-4e61-af97-1549116d4ebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:06.435392 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57d1c-90c6-47a0-851e-b580ec4f0ec5 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.435794 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36572d-c663-4e61-af97-1549116d4ebb None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:06.452584 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 308/607] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:06.453387 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36572d-c663-4e61-af97-1549116d4ebb None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.462110 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:06.471788 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d21e7c-accd-42c3-b1ec-5eb6c3aafd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.472458 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d21e7c-accd-42c3-b1ec-5eb6c3aafd36 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.472744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d21e7c-accd-42c3-b1ec-5eb6c3aafd36 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.473026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d21e7c-accd-42c3-b1ec-5eb6c3aafd36 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.473771 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d21e7c-accd-42c3-b1ec-5eb6c3aafd36 None admin] RBAC: Adding query filter params (name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:06.474080 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d21e7c-accd-42c3-b1ec-5eb6c3aafd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:06.475492 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d21e7c-accd-42c3-b1ec-5eb6c3aafd36 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:06.484019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 300/608] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:06.484911 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d21e7c-accd-42c3-b1ec-5eb6c3aafd36 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.555030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36572d-c663-4e61-af97-1549116d4ebb None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.584168 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d21e7c-accd-42c3-b1ec-5eb6c3aafd36 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.589131 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a383-b596-4dbd-9bd2-2ce31825fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.589922 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a383-b596-4dbd-9bd2-2ce31825fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.590209 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a383-b596-4dbd-9bd2-2ce31825fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.590520 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a383-b596-4dbd-9bd2-2ce31825fdc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.600663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72a383-b596-4dbd-9bd2-2ce31825fdc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:57:06.606399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-eb72a383-b596-4dbd-9bd2-2ce31825fdc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:57:06.608226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:06.609235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:06.610072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 309/609] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:06.610820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a383-b596-4dbd-9bd2-2ce31825fdc0 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.619718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e7f2f-3b89-4e47-a38e-1e116078e8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.620510 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e7f2f-3b89-4e47-a38e-1e116078e8c5 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.620797 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e7f2f-3b89-4e47-a38e-1e116078e8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.621077 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e7f2f-3b89-4e47-a38e-1e116078e8c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.628053 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e7f2f-3b89-4e47-a38e-1e116078e8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:06.629721 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e7f2f-3b89-4e47-a38e-1e116078e8c5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-086e7f2f-3b89-4e47-a38e-1e116078e8c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:06.644999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:06.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:06.647064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:06.647064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:06.647064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:06.647064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:06.647064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:06.647064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:06.647064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:06.647064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:06.647064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 301/610] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:06.647548 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e7f2f-3b89-4e47-a38e-1e116078e8c5 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.678271 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:06.712879 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a383-b596-4dbd-9bd2-2ce31825fdc0 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.745657 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580e563-f08b-4fc4-a170-1e16fe70d4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.746355 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580e563-f08b-4fc4-a170-1e16fe70d4e0 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.746642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580e563-f08b-4fc4-a170-1e16fe70d4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.746921 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580e563-f08b-4fc4-a170-1e16fe70d4e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.747979 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e7f2f-3b89-4e47-a38e-1e116078e8c5 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.781828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18229e7f-aa71-4ab8-a2c9-b2d1bc6cf53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.782645 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18229e7f-aa71-4ab8-a2c9-b2d1bc6cf53d None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.782935 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18229e7f-aa71-4ab8-a2c9-b2d1bc6cf53d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.783218 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18229e7f-aa71-4ab8-a2c9-b2d1bc6cf53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.793741 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18229e7f-aa71-4ab8-a2c9-b2d1bc6cf53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:06.795221 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18229e7f-aa71-4ab8-a2c9-b2d1bc6cf53d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-18229e7f-aa71-4ab8-a2c9-b2d1bc6cf53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:06.812349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:06.813391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:06.814307 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:06.814307 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:06.814307 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:06.814307 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:06.814569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580e563-f08b-4fc4-a170-1e16fe70d4e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:06.814645 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 302/611] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:06.814720 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580e563-f08b-4fc4-a170-1e16fe70d4e0 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:06.814788 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18229e7f-aa71-4ab8-a2c9-b2d1bc6cf53d None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.849836 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:06.880710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:06.914776 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 310/612] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:57:06.915612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580e563-f08b-4fc4-a170-1e16fe70d4e0 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:06.918161 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18229e7f-aa71-4ab8-a2c9-b2d1bc6cf53d None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:06.953671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d68a-7532-46f6-a495-ac0b3236cdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:06.954363 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d68a-7532-46f6-a495-ac0b3236cdb8 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:06.954642 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d68a-7532-46f6-a495-ac0b3236cdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:06.954924 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d68a-7532-46f6-a495-ac0b3236cdb8 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:06.955675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29d68a-7532-46f6-a495-ac0b3236cdb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:06.955985 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29d68a-7532-46f6-a495-ac0b3236cdb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:06.957340 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29d68a-7532-46f6-a495-ac0b3236cdb8 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:06.965361 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 303/613] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:06.966138 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d68a-7532-46f6-a495-ac0b3236cdb8 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.014927 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580e563-f08b-4fc4-a170-1e16fe70d4e0 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.048194 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20501-b0c1-4861-9e9f-0995d06abf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.048850 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20501-b0c1-4861-9e9f-0995d06abf19 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.049138 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20501-b0c1-4861-9e9f-0995d06abf19 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.049424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20501-b0c1-4861-9e9f-0995d06abf19 None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.050215 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20501-b0c1-4861-9e9f-0995d06abf19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:07.050549 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20501-b0c1-4861-9e9f-0995d06abf19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.051981 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20501-b0c1-4861-9e9f-0995d06abf19 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.059642 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:07.063793 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 311/614] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:07.064575 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20501-b0c1-4861-9e9f-0995d06abf19 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.065215 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d68a-7532-46f6-a495-ac0b3236cdb8 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.093911 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:07.099293 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e335b-1ea6-49da-a9f1-d8eed1be9c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.099949 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e335b-1ea6-49da-a9f1-d8eed1be9c2f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.100233 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e335b-1ea6-49da-a9f1-d8eed1be9c2f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.100507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e335b-1ea6-49da-a9f1-d8eed1be9c2f None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.101220 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e335b-1ea6-49da-a9f1-d8eed1be9c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:07.101531 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e335b-1ea6-49da-a9f1-d8eed1be9c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.102963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e335b-1ea6-49da-a9f1-d8eed1be9c2f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.115138 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 304/615] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:07.115933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e335b-1ea6-49da-a9f1-d8eed1be9c2f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.170387 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20501-b0c1-4861-9e9f-0995d06abf19 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.204110 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380c772-898f-47e6-bf52-272619c581b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.204898 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380c772-898f-47e6-bf52-272619c581b4 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.205187 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380c772-898f-47e6-bf52-272619c581b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.205476 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380c772-898f-47e6-bf52-272619c581b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.213854 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e335b-1ea6-49da-a9f1-d8eed1be9c2f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.215965 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380c772-898f-47e6-bf52-272619c581b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.217422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380c772-898f-47e6-bf52-272619c581b4 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-d380c772-898f-47e6-bf52-272619c581b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:07.234045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:07.234988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:07.235885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:07.235885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:07.235885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:07.235885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:07.238471 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 312/616] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:07.239594 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380c772-898f-47e6-bf52-272619c581b4 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.247931 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538285f-d583-48aa-af23-87533f7f874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.248722 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538285f-d583-48aa-af23-87533f7f874f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.249009 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538285f-d583-48aa-af23-87533f7f874f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.249288 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538285f-d583-48aa-af23-87533f7f874f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.260054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538285f-d583-48aa-af23-87533f7f874f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.261519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538285f-d583-48aa-af23-87533f7f874f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-4538285f-d583-48aa-af23-87533f7f874f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:07.278872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:07.279927 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:07.280926 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:07.280926 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:07.280926 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:07.280926 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:07.282475 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 305/617] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:07.283415 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538285f-d583-48aa-af23-87533f7f874f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.293855 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:07.317438 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:07.337906 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380c772-898f-47e6-bf52-272619c581b4 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.371539 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f695a6-f574-4615-a6e6-274caa87740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.372184 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f695a6-f574-4615-a6e6-274caa87740b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.372470 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f695a6-f574-4615-a6e6-274caa87740b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.372745 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f695a6-f574-4615-a6e6-274caa87740b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.373573 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f695a6-f574-4615-a6e6-274caa87740b None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=f446e118975f44b4b31511302a7af36e) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:07.373886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f695a6-f574-4615-a6e6-274caa87740b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.375359 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f695a6-f574-4615-a6e6-274caa87740b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.381345 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 313/618] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/role_assignments?user.id=f446e118975f44b4b31511302a7af36e&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:07.381694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538285f-d583-48aa-af23-87533f7f874f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.382168 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f695a6-f574-4615-a6e6-274caa87740b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.432986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d66216-58c0-41a9-a175-7251170b60f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.433711 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d66216-58c0-41a9-a175-7251170b60f9 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.433994 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d66216-58c0-41a9-a175-7251170b60f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.434273 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d66216-58c0-41a9-a175-7251170b60f9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.442420 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d66216-58c0-41a9-a175-7251170b60f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.443904 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d66216-58c0-41a9-a175-7251170b60f9 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-07d66216-58c0-41a9-a175-7251170b60f9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:07.459810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:07.461001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:07.462170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 306/619] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:07.462891 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d66216-58c0-41a9-a175-7251170b60f9 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.503726 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f695a6-f574-4615-a6e6-274caa87740b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.538258 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:07.540699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9eb07-3956-405c-854f-aa0e9cb2ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.541417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9eb07-3956-405c-854f-aa0e9cb2ca2f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.541714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9eb07-3956-405c-854f-aa0e9cb2ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.542046 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9eb07-3956-405c-854f-aa0e9cb2ca2f None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.542845 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9eb07-3956-405c-854f-aa0e9cb2ca2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:07.543153 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9eb07-3956-405c-854f-aa0e9cb2ca2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.544592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9eb07-3956-405c-854f-aa0e9cb2ca2f None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.562842 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 314/620] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:07.562842 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9eb07-3956-405c-854f-aa0e9cb2ca2f None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.565841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:07.584535 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d66216-58c0-41a9-a175-7251170b60f9 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.625970 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c1b2a-4415-49cd-bef3-0d0259d0aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.627360 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c1b2a-4415-49cd-bef3-0d0259d0aedc None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.627360 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c1b2a-4415-49cd-bef3-0d0259d0aedc None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.627360 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c1b2a-4415-49cd-bef3-0d0259d0aedc None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.628315 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c1b2a-4415-49cd-bef3-0d0259d0aedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:07.628667 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c1b2a-4415-49cd-bef3-0d0259d0aedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.630047 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c1b2a-4415-49cd-bef3-0d0259d0aedc None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.642300 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 307/621] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:07.643302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c1b2a-4415-49cd-bef3-0d0259d0aedc None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.683396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9eb07-3956-405c-854f-aa0e9cb2ca2f None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.722712 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f9f4e-eab2-4627-84c7-7ee185520335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.723383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f9f4e-eab2-4627-84c7-7ee185520335 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.723669 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f9f4e-eab2-4627-84c7-7ee185520335 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.723952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f9f4e-eab2-4627-84c7-7ee185520335 None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.724816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f9f4e-eab2-4627-84c7-7ee185520335 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:07.725130 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f9f4e-eab2-4627-84c7-7ee185520335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.726630 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f9f4e-eab2-4627-84c7-7ee185520335 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.745806 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 315/622] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:07.747313 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f9f4e-eab2-4627-84c7-7ee185520335 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.780451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c1b2a-4415-49cd-bef3-0d0259d0aedc None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.810572 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:07.812643 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:07.821076 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e1621-a0a0-450d-b640-8f8acb40154b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.821898 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1621-a0a0-450d-b640-8f8acb40154b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.822189 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1621-a0a0-450d-b640-8f8acb40154b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.822517 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1621-a0a0-450d-b640-8f8acb40154b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.830078 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e1621-a0a0-450d-b640-8f8acb40154b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.831578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e1621-a0a0-450d-b640-8f8acb40154b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-481e1621-a0a0-450d-b640-8f8acb40154b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:07.846806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:07.847770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:07.848707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:07.848707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:07.848707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:07.848707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:07.848707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:07.848707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:07.848707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:07.848707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:07.848707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 308/623] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:07.849202 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e1621-a0a0-450d-b640-8f8acb40154b None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.860432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f9f4e-eab2-4627-84c7-7ee185520335 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:07.903542 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40b70-c459-437b-9764-09791c36ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:07.904347 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40b70-c459-437b-9764-09791c36ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:07.904796 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40b70-c459-437b-9764-09791c36ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:07.905078 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40b70-c459-437b-9764-09791c36ecd6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:07.914584 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e40b70-c459-437b-9764-09791c36ecd6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:07.916038 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e40b70-c459-437b-9764-09791c36ecd6 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-94e40b70-c459-437b-9764-09791c36ecd6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:07.934578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:07.935577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:07.936551 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 316/624] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:07.939183 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40b70-c459-437b-9764-09791c36ecd6 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:07.969890 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e1621-a0a0-450d-b640-8f8acb40154b None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:08.010275 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbd4bd-95a3-4b8f-a571-f03358c41de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:08.010988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbd4bd-95a3-4b8f-a571-f03358c41de0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:08.011276 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbd4bd-95a3-4b8f-a571-f03358c41de0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:08.011552 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbd4bd-95a3-4b8f-a571-f03358c41de0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:08.051543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40b70-c459-437b-9764-09791c36ecd6 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:08.071648 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:08.072388 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:08.084726 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbd4bd-95a3-4b8f-a571-f03358c41de0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:08.085569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e57cd-b4f8-457b-a92a-cdf053e0807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:08.086197 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbd4bd-95a3-4b8f-a571-f03358c41de0 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:08.086355 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e57cd-b4f8-457b-a92a-cdf053e0807b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:08.086570 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e57cd-b4f8-457b-a92a-cdf053e0807b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:08.086857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e57cd-b4f8-457b-a92a-cdf053e0807b None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:08.087647 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e57cd-b4f8-457b-a92a-cdf053e0807b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:08.087965 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e57cd-b4f8-457b-a92a-cdf053e0807b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:08.089388 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e57cd-b4f8-457b-a92a-cdf053e0807b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:08.101755 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 317/625] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:08.103696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e57cd-b4f8-457b-a92a-cdf053e0807b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:08.203579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 309/626] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:57:08.203579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbd4bd-95a3-4b8f-a571-f03358c41de0 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:08.219537 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e57cd-b4f8-457b-a92a-cdf053e0807b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:08.256228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccdb7f-0990-4de2-8dea-6818bf790ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:08.256900 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccdb7f-0990-4de2-8dea-6818bf790ff2 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:08.257186 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccdb7f-0990-4de2-8dea-6818bf790ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:08.257464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccdb7f-0990-4de2-8dea-6818bf790ff2 None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:08.258413 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccdb7f-0990-4de2-8dea-6818bf790ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:08.258727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccdb7f-0990-4de2-8dea-6818bf790ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:08.260159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccdb7f-0990-4de2-8dea-6818bf790ff2 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:08.282655 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 318/627] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Jun 6 06:57:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:08.282655 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccdb7f-0990-4de2-8dea-6818bf790ff2 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:08.298461 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:08.311750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbd4bd-95a3-4b8f-a571-f03358c41de0 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:08.321642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:08.347274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2b36-5cce-4a5c-a1b0-0609a979f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:08.347937 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2b36-5cce-4a5c-a1b0-0609a979f858 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:08.348236 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2b36-5cce-4a5c-a1b0-0609a979f858 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:08.348520 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2b36-5cce-4a5c-a1b0-0609a979f858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:08.349350 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb2b36-5cce-4a5c-a1b0-0609a979f858 None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=b1618d2efb0c45f98a081126f5342abc) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:08.349662 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb2b36-5cce-4a5c-a1b0-0609a979f858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:08.351117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb2b36-5cce-4a5c-a1b0-0609a979f858 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:08.362364 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 310/628] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:57:08 2022] GET /identity/v3/role_assignments?user.id=b1618d2efb0c45f98a081126f5342abc&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:08.362364 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2b36-5cce-4a5c-a1b0-0609a979f858 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:08.393244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccdb7f-0990-4de2-8dea-6818bf790ff2 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:08.431741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867c336-9413-403d-9f08-2efc1ea89991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:08.432695 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867c336-9413-403d-9f08-2efc1ea89991 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:08.433067 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867c336-9413-403d-9f08-2efc1ea89991 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:08.433349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867c336-9413-403d-9f08-2efc1ea89991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:08.445171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867c336-9413-403d-9f08-2efc1ea89991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:08.446767 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867c336-9413-403d-9f08-2efc1ea89991 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-2867c336-9413-403d-9f08-2efc1ea89991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:08.466442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:08.467432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:08.469220 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:08.469220 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:08.469220 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:08.469220 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:08.469220 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 319/629] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:08.473253 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867c336-9413-403d-9f08-2efc1ea89991 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:08.505390 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2b36-5cce-4a5c-a1b0-0609a979f858 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:08.545533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f064e7-fd62-48c5-b066-4605772b9fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:08.546378 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f064e7-fd62-48c5-b066-4605772b9fb6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:08.546676 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f064e7-fd62-48c5-b066-4605772b9fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:08.546962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f064e7-fd62-48c5-b066-4605772b9fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:08.573017 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:08.591144 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:08.605054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867c336-9413-403d-9f08-2efc1ea89991 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:08.629896 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f064e7-fd62-48c5-b066-4605772b9fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:08.631537 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f064e7-fd62-48c5-b066-4605772b9fb6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:08.647791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4555-bc0b-4c55-aba8-dc3ea8482b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:08.648712 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4555-bc0b-4c55-aba8-dc3ea8482b67 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:08.649554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4555-bc0b-4c55-aba8-dc3ea8482b67 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:08.649838 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4555-bc0b-4c55-aba8-dc3ea8482b67 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:08.651010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd4555-bc0b-4c55-aba8-dc3ea8482b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:08.651326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd4555-bc0b-4c55-aba8-dc3ea8482b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:08.652713 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd4555-bc0b-4c55-aba8-dc3ea8482b67 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:08.666367 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 320/630] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:08.671500 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4555-bc0b-4c55-aba8-dc3ea8482b67 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:08.768798 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 311/631] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:57:08.774422 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f064e7-fd62-48c5-b066-4605772b9fb6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:08.793113 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4555-bc0b-4c55-aba8-dc3ea8482b67 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:08.833043 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b2868-44ec-414b-b7a7-c5ec3e03cab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:08.834689 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2868-44ec-414b-b7a7-c5ec3e03cab8 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:08.835063 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2868-44ec-414b-b7a7-c5ec3e03cab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:08.835416 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2868-44ec-414b-b7a7-c5ec3e03cab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:08.840633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:08.845272 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b2868-44ec-414b-b7a7-c5ec3e03cab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:08.847198 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b2868-44ec-414b-b7a7-c5ec3e03cab8 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-e80b2868-44ec-414b-b7a7-c5ec3e03cab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:08.866054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:08.867009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:08.868519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:08.868519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:08.868519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:08.868519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:08.868519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:08.868519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:08.868519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:08.868519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:08.870472 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 321/632] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:08.874283 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b2868-44ec-414b-b7a7-c5ec3e03cab8 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:08.887292 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:08.903301 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f064e7-fd62-48c5-b066-4605772b9fb6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:08.947227 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4beb4-0630-4e2a-878f-fa1938439c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:08.948811 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4beb4-0630-4e2a-878f-fa1938439c24 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:08.949254 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4beb4-0630-4e2a-878f-fa1938439c24 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:08.949931 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4beb4-0630-4e2a-878f-fa1938439c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:08.965026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4beb4-0630-4e2a-878f-fa1938439c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:08.967864 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4beb4-0630-4e2a-878f-fa1938439c24 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-82c4beb4-0630-4e2a-878f-fa1938439c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:08.994804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:08.995917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:08.997036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:08.997036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:08.997036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:08.997036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:08.999855 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 312/633] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:09.005352 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4beb4-0630-4e2a-878f-fa1938439c24 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:09.006585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b2868-44ec-414b-b7a7-c5ec3e03cab8 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:09.044241 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432667a6-29bc-45f9-b95d-62a3c998a3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:09.045828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432667a6-29bc-45f9-b95d-62a3c998a3aa None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:09.046516 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432667a6-29bc-45f9-b95d-62a3c998a3aa None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:09.047146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432667a6-29bc-45f9-b95d-62a3c998a3aa None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:09.048768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432667a6-29bc-45f9-b95d-62a3c998a3aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:09.049283 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432667a6-29bc-45f9-b95d-62a3c998a3aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:09.051115 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432667a6-29bc-45f9-b95d-62a3c998a3aa None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:09.067717 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 322/634] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:09.073809 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432667a6-29bc-45f9-b95d-62a3c998a3aa None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:09.125665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4beb4-0630-4e2a-878f-fa1938439c24 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:09.128322 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:09.154206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:09.161425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd175b-d039-40c7-a2a7-734720db4ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:09.162017 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd175b-d039-40c7-a2a7-734720db4ec7 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:09.162305 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd175b-d039-40c7-a2a7-734720db4ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:09.162619 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd175b-d039-40c7-a2a7-734720db4ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:09.163344 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd175b-d039-40c7-a2a7-734720db4ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:09.163656 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd175b-d039-40c7-a2a7-734720db4ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:09.165922 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd175b-d039-40c7-a2a7-734720db4ec7 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:09.183030 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 313/635] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:09.184479 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd175b-d039-40c7-a2a7-734720db4ec7 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:09.190948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432667a6-29bc-45f9-b95d-62a3c998a3aa None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:09.231009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11183516-8c58-4a48-9e24-3127ac87bb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:09.232451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11183516-8c58-4a48-9e24-3127ac87bb57 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:09.232906 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11183516-8c58-4a48-9e24-3127ac87bb57 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:09.233390 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11183516-8c58-4a48-9e24-3127ac87bb57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:09.234493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11183516-8c58-4a48-9e24-3127ac87bb57 None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=1c3429d0ba28474698c6c168270d314b) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:09.234962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11183516-8c58-4a48-9e24-3127ac87bb57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:09.236773 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11183516-8c58-4a48-9e24-3127ac87bb57 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:09.250666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 323/636] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:57:09 2022] GET /identity/v3/role_assignments?user.id=1c3429d0ba28474698c6c168270d314b&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:09.298120 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd175b-d039-40c7-a2a7-734720db4ec7 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:09.337538 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa8c13-110b-4a1f-94ca-cde75de54dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:09.338459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa8c13-110b-4a1f-94ca-cde75de54dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:09.338748 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa8c13-110b-4a1f-94ca-cde75de54dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:09.339088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa8c13-110b-4a1f-94ca-cde75de54dd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:09.347500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa8c13-110b-4a1f-94ca-cde75de54dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:09.349101 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa8c13-110b-4a1f-94ca-cde75de54dd2 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-23fa8c13-110b-4a1f-94ca-cde75de54dd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:09.364800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:09.365768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:09.366688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:09.366688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:09.366688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:09.366688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:09.366688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:09.366688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:09.366688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:09.366688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:09.370589 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 314/637] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:09.373265 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11183516-8c58-4a48-9e24-3127ac87bb57 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:09.490178 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11183516-8c58-4a48-9e24-3127ac87bb57 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:09.528990 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea7fd-dd9a-48af-9c22-b629fbe31c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:09.529651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea7fd-dd9a-48af-9c22-b629fbe31c70 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:09.529933 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea7fd-dd9a-48af-9c22-b629fbe31c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:09.530208 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea7fd-dd9a-48af-9c22-b629fbe31c70 None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:09.531153 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea7fd-dd9a-48af-9c22-b629fbe31c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:09.531457 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea7fd-dd9a-48af-9c22-b629fbe31c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:09.532816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea7fd-dd9a-48af-9c22-b629fbe31c70 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:09.534654 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:09.546443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 324/638] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:09.552220 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa8c13-110b-4a1f-94ca-cde75de54dd2 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:09.579378 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:09.659532 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa8c13-110b-4a1f-94ca-cde75de54dd2 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:09.696972 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80c1d3-fe7e-4c29-8db0-4444ab5478a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:09.697645 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80c1d3-fe7e-4c29-8db0-4444ab5478a0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:09.697934 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80c1d3-fe7e-4c29-8db0-4444ab5478a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:09.698217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80c1d3-fe7e-4c29-8db0-4444ab5478a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:09.699091 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80c1d3-fe7e-4c29-8db0-4444ab5478a0 None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=77904d1264284c29b2d0b73831dd4096) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:09.699407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80c1d3-fe7e-4c29-8db0-4444ab5478a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:09.700859 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80c1d3-fe7e-4c29-8db0-4444ab5478a0 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:09.707335 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 315/639] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:57:09 2022] GET /identity/v3/role_assignments?user.id=77904d1264284c29b2d0b73831dd4096&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:09.842045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa7b7a-23dd-4769-b11d-ab1e1bb4d799 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:09.842356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa7b7a-23dd-4769-b11d-ab1e1bb4d799 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:09.842661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa7b7a-23dd-4769-b11d-ab1e1bb4d799 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:09.844352 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 325/640] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:09.850092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f9aa-f3d2-4533-8b2c-71b78edfdc23 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:09.850454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f9aa-f3d2-4533-8b2c-71b78edfdc23 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:09.850696 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f9aa-f3d2-4533-8b2c-71b78edfdc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:09.870288 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-62c0f9aa-f3d2-4533-8b2c-71b78edfdc23 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:09.871550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-62c0f9aa-f3d2-4533-8b2c-71b78edfdc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:09.956606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 316/641] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:09.981761 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa7b7a-23dd-4769-b11d-ab1e1bb4d799 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:10.088386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa7b7a-23dd-4769-b11d-ab1e1bb4d799 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:10.124647 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc51431-b9e0-485a-b578-1ed16551b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:10.125725 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc51431-b9e0-485a-b578-1ed16551b2ec None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:10.126211 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc51431-b9e0-485a-b578-1ed16551b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:10.126693 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc51431-b9e0-485a-b578-1ed16551b2ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:10.138348 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc51431-b9e0-485a-b578-1ed16551b2ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-cbc51431-b9e0-485a-b578-1ed16551b2ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:57:10.146171 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:10.147246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:57:10.148151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:10.150671 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 326/642] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:57:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:10.156710 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0f9aa-f3d2-4533-8b2c-71b78edfdc23 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:10.175648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:10.266412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0f9aa-f3d2-4533-8b2c-71b78edfdc23 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:10.301111 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8043805-50a4-42b0-a5ac-da6b207a57b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:10.302058 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8043805-50a4-42b0-a5ac-da6b207a57b4 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:10.302544 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8043805-50a4-42b0-a5ac-da6b207a57b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:10.302965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8043805-50a4-42b0-a5ac-da6b207a57b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:10.303851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8043805-50a4-42b0-a5ac-da6b207a57b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:10.304304 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8043805-50a4-42b0-a5ac-da6b207a57b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:10.306413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8043805-50a4-42b0-a5ac-da6b207a57b4 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:10.315697 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 317/643] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:57:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:10.326371 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc51431-b9e0-485a-b578-1ed16551b2ec None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:10.390849 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:10.425725 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc51431-b9e0-485a-b578-1ed16551b2ec None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:10.460875 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43ffc4-2d54-4a3e-a79a-17b08c6f06b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:10.461705 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ffc4-2d54-4a3e-a79a-17b08c6f06b6 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:10.461998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ffc4-2d54-4a3e-a79a-17b08c6f06b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:10.462275 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ffc4-2d54-4a3e-a79a-17b08c6f06b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:10.473602 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43ffc4-2d54-4a3e-a79a-17b08c6f06b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:10.475121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43ffc4-2d54-4a3e-a79a-17b08c6f06b6 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-af43ffc4-2d54-4a3e-a79a-17b08c6f06b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:10.496328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:10.497267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:10.498943 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:10.498943 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:10.498943 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:10.498943 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:10.498943 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 327/644] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:10.503762 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8043805-50a4-42b0-a5ac-da6b207a57b4 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:10.605649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:10.628478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8043805-50a4-42b0-a5ac-da6b207a57b4 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:10.665341 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34582f-daf5-422b-a71a-610de88d73eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:10.666389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34582f-daf5-422b-a71a-610de88d73eb None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:10.667105 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34582f-daf5-422b-a71a-610de88d73eb None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:10.667825 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34582f-daf5-422b-a71a-610de88d73eb None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:10.669311 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34582f-daf5-422b-a71a-610de88d73eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:10.670059 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34582f-daf5-422b-a71a-610de88d73eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:10.671764 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34582f-daf5-422b-a71a-610de88d73eb None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:10.684226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 318/645] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:10.691477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43ffc4-2d54-4a3e-a79a-17b08c6f06b6 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:10.792592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43ffc4-2d54-4a3e-a79a-17b08c6f06b6 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:10.799728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:10.830888 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a2f5-ac1f-4ee0-a3e4-6e59e73afaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:10.831757 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a2f5-ac1f-4ee0-a3e4-6e59e73afaca None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:10.832049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a2f5-ac1f-4ee0-a3e4-6e59e73afaca None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:10.832328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a2f5-ac1f-4ee0-a3e4-6e59e73afaca None admin] PATH_INFO: `/v3/users/nova` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:10.840949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a2f5-ac1f-4ee0-a3e4-6e59e73afaca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:10.842548 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a2f5-ac1f-4ee0-a3e4-6e59e73afaca None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-2b03a2f5-ac1f-4ee0-a3e4-6e59e73afaca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:10.857595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:10.858595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:10.859554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 328/646] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jun 6 06:57:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:10.864556 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34582f-daf5-422b-a71a-610de88d73eb None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:10.974251 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baad87-2563-4a0b-a407-ba583539003b None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:10.974586 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baad87-2563-4a0b-a407-ba583539003b None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:10.974856 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baad87-2563-4a0b-a407-ba583539003b None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:10.976527 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 329/647] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:57:10.982296 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807c2c-3520-471b-ba35-25732a06b714 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:10.982710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807c2c-3520-471b-ba35-25732a06b714 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:10.987596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807c2c-3520-471b-ba35-25732a06b714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:10.987766 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34582f-daf5-422b-a71a-610de88d73eb None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:11.010961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-b2807c2c-3520-471b-ba35-25732a06b714 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:11.012953 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-b2807c2c-3520-471b-ba35-25732a06b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:11.029367 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58ee09-61cd-43d4-9880-285cb506e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:11.030651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58ee09-61cd-43d4-9880-285cb506e6da None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:11.033373 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58ee09-61cd-43d4-9880-285cb506e6da None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:11.033373 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58ee09-61cd-43d4-9880-285cb506e6da None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:11.033373 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58ee09-61cd-43d4-9880-285cb506e6da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:11.033989 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58ee09-61cd-43d4-9880-285cb506e6da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:11.036312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58ee09-61cd-43d4-9880-285cb506e6da None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:11.050386 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:11.066763 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 319/648] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jun 6 06:57:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:11.067988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58ee09-61cd-43d4-9880-285cb506e6da None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:11.110376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 330/649] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:11.134306 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2807c2c-3520-471b-ba35-25732a06b714 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:11.189986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58ee09-61cd-43d4-9880-285cb506e6da None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:11.231480 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150e292-00ba-4730-aaa0-9f75d8ab4c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:11.232311 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150e292-00ba-4730-aaa0-9f75d8ab4c89 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:11.232700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150e292-00ba-4730-aaa0-9f75d8ab4c89 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:11.233106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150e292-00ba-4730-aaa0-9f75d8ab4c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:11.258854 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:11.266348 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2807c2c-3520-471b-ba35-25732a06b714 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:11.303109 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029407f-6e66-478d-bd8a-2216ec0fa7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:11.303905 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029407f-6e66-478d-bd8a-2216ec0fa7eb None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:11.304177 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029407f-6e66-478d-bd8a-2216ec0fa7eb None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:11.304449 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029407f-6e66-478d-bd8a-2216ec0fa7eb None admin] PATH_INFO: `/v3/services/image` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:11.305192 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029407f-6e66-478d-bd8a-2216ec0fa7eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:11.306750 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029407f-6e66-478d-bd8a-2216ec0fa7eb None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-d029407f-6e66-478d-bd8a-2216ec0fa7eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:11.321629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:11.329640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:11.330514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 331/650] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Jun 6 06:57:11 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:11.331315 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029407f-6e66-478d-bd8a-2216ec0fa7eb None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:11.332313 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:11.337044 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150e292-00ba-4730-aaa0-9f75d8ab4c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:11.339813 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150e292-00ba-4730-aaa0-9f75d8ab4c89 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:11.453938 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029407f-6e66-478d-bd8a-2216ec0fa7eb None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:11.480330 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 320/651] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 06 06:57:11.481104 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150e292-00ba-4730-aaa0-9f75d8ab4c89 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:11.500975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a47332-4f79-418c-b84a-41625d701c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:11.502012 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a47332-4f79-418c-b84a-41625d701c16 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:11.502556 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a47332-4f79-418c-b84a-41625d701c16 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:11.503703 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a47332-4f79-418c-b84a-41625d701c16 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:11.504930 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a47332-4f79-418c-b84a-41625d701c16 None admin] RBAC: Adding query filter params (name=image) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:11.505445 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a47332-4f79-418c-b84a-41625d701c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:11.507801 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a47332-4f79-418c-b84a-41625d701c16 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:11.519499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 332/652] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:11.520502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a47332-4f79-418c-b84a-41625d701c16 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:11.556610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:11.585223 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:11.590631 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150e292-00ba-4730-aaa0-9f75d8ab4c89 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:11.629414 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e08c52-0656-4602-ad32-d62a71f1b763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:11.630206 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08c52-0656-4602-ad32-d62a71f1b763 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:11.630543 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08c52-0656-4602-ad32-d62a71f1b763 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:11.630823 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08c52-0656-4602-ad32-d62a71f1b763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:11.642787 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e08c52-0656-4602-ad32-d62a71f1b763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:11.644351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e08c52-0656-4602-ad32-d62a71f1b763 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:11.656152 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a47332-4f79-418c-b84a-41625d701c16 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-e8e08c52-0656-4602-ad32-d62a71f1b763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:11.664539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:11.665954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:11.671717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:11.671717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:11.671717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:11.671717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:11.671717 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 321/653] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:11.673008 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e08c52-0656-4602-ad32-d62a71f1b763 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:11.706710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0fe9-cdd5-4a4c-ae77-c1645b18e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:11.707852 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0fe9-cdd5-4a4c-ae77-c1645b18e039 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:11.708507 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0fe9-cdd5-4a4c-ae77-c1645b18e039 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:11.708991 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0fe9-cdd5-4a4c-ae77-c1645b18e039 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:11.710699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b0fe9-cdd5-4a4c-ae77-c1645b18e039 None admin] RBAC: Adding query filter params (type=image) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:11.711224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b0fe9-cdd5-4a4c-ae77-c1645b18e039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:11.713357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b0fe9-cdd5-4a4c-ae77-c1645b18e039 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:11.726573 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 333/654] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:11.740169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9a03-e3d5-4bac-b7c5-32a7560cc8e8 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:11.740492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9a03-e3d5-4bac-b7c5-32a7560cc8e8 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:11.740742 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9a03-e3d5-4bac-b7c5-32a7560cc8e8 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:11.742470 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 334/655] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:57:11.748212 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577cf50-d96f-4da7-94a9-39ff71350da2 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:11.748509 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577cf50-d96f-4da7-94a9-39ff71350da2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:11.748794 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577cf50-d96f-4da7-94a9-39ff71350da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:11.773629 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-a577cf50-d96f-4da7-94a9-39ff71350da2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:11.776701 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-a577cf50-d96f-4da7-94a9-39ff71350da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:11.795290 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e08c52-0656-4602-ad32-d62a71f1b763 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:11.842898 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d46a4-a863-48fc-9ae9-76bf407be301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:11.844095 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d46a4-a863-48fc-9ae9-76bf407be301 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:11.844576 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d46a4-a863-48fc-9ae9-76bf407be301 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:11.845190 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d46a4-a863-48fc-9ae9-76bf407be301 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:11.846270 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d46a4-a863-48fc-9ae9-76bf407be301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:11.846828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d46a4-a863-48fc-9ae9-76bf407be301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:11.848464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d46a4-a863-48fc-9ae9-76bf407be301 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:11.862750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 322/656] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:11.868324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d46a4-a863-48fc-9ae9-76bf407be301 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:11.882589 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 335/657] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:57:11.885476 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:11.918790 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577cf50-d96f-4da7-94a9-39ff71350da2 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:11.959821 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:12.001295 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d46a4-a863-48fc-9ae9-76bf407be301 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:12.043595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c24a7-4fea-447f-a187-f7f7e4086b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:12.044396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c24a7-4fea-447f-a187-f7f7e4086b72 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.044680 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c24a7-4fea-447f-a187-f7f7e4086b72 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.044960 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c24a7-4fea-447f-a187-f7f7e4086b72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.051889 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c24a7-4fea-447f-a187-f7f7e4086b72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:12.053347 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c24a7-4fea-447f-a187-f7f7e4086b72 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:12.064407 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577cf50-d96f-4da7-94a9-39ff71350da2 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-fb6c24a7-4fea-447f-a187-f7f7e4086b72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:12.067835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:12.068730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:12.069630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:12.069630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:12.069630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:12.069630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:12.069630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:12.069630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:12.069630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:12.069630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:12.069630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 323/658] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:12.074884 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c24a7-4fea-447f-a187-f7f7e4086b72 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:12.114382 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fb6a3-8c44-4900-94ad-ed69614c06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:12.115534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fb6a3-8c44-4900-94ad-ed69614c06a9 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.115997 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fb6a3-8c44-4900-94ad-ed69614c06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.116461 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fb6a3-8c44-4900-94ad-ed69614c06a9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.117309 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fb6a3-8c44-4900-94ad-ed69614c06a9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:12.119977 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fb6a3-8c44-4900-94ad-ed69614c06a9 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-3a3fb6a3-8c44-4900-94ad-ed69614c06a9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:12.137949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:12.138969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 06:57:12.139800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:12.143083 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 336/659] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Jun 6 06:57:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:12.148827 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fb6a3-8c44-4900-94ad-ed69614c06a9 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:12.157532 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:12.199982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c24a7-4fea-447f-a187-f7f7e4086b72 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:12.241214 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:12.246345 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241eef9d-d2df-49df-ad61-5b682f5c2a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:12.247034 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eef9d-d2df-49df-ad61-5b682f5c2a0f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.247328 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eef9d-d2df-49df-ad61-5b682f5c2a0f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.247693 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eef9d-d2df-49df-ad61-5b682f5c2a0f None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.248454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eef9d-d2df-49df-ad61-5b682f5c2a0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:12.248769 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eef9d-d2df-49df-ad61-5b682f5c2a0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:12.250212 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241eef9d-d2df-49df-ad61-5b682f5c2a0f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:12.267121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fb6a3-8c44-4900-94ad-ed69614c06a9 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:12.269454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 324/660] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:12.270910 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba3b14-6d22-4b21-8cce-8bca5bdf2698 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.271206 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba3b14-6d22-4b21-8cce-8bca5bdf2698 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.271492 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba3b14-6d22-4b21-8cce-8bca5bdf2698 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.275007 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 325/661] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:12.275646 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba3b14-6d22-4b21-8cce-8bca5bdf2698 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:12.319274 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4b52c-cabe-4427-8c59-4de9b9d2a7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:12.319993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b52c-cabe-4427-8c59-4de9b9d2a7aa None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.320278 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b52c-cabe-4427-8c59-4de9b9d2a7aa None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.320554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b52c-cabe-4427-8c59-4de9b9d2a7aa None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.321859 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4b52c-cabe-4427-8c59-4de9b9d2a7aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:12.322369 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4b52c-cabe-4427-8c59-4de9b9d2a7aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:12.324501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4b52c-cabe-4427-8c59-4de9b9d2a7aa None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:12.334628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 337/662] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jun 6 06:57:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:12.334628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d785ef-1eaf-46c7-941e-f3502a5ff0dd None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.334628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d785ef-1eaf-46c7-941e-f3502a5ff0dd None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.334628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d785ef-1eaf-46c7-941e-f3502a5ff0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.352501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-95d785ef-1eaf-46c7-941e-f3502a5ff0dd None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:12.353737 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-95d785ef-1eaf-46c7-941e-f3502a5ff0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:12.397996 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba3b14-6d22-4b21-8cce-8bca5bdf2698 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:12.428086 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 338/663] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:12.429238 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d785ef-1eaf-46c7-941e-f3502a5ff0dd None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:12.434946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:12.441530 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d67582-cd3b-4de5-8f8b-b5ad8ccd618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:12.442194 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d67582-cd3b-4de5-8f8b-b5ad8ccd618b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.442515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d67582-cd3b-4de5-8f8b-b5ad8ccd618b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.442798 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d67582-cd3b-4de5-8f8b-b5ad8ccd618b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.443630 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d67582-cd3b-4de5-8f8b-b5ad8ccd618b None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=f446e118975f44b4b31511302a7af36e) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:12.444093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d67582-cd3b-4de5-8f8b-b5ad8ccd618b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:12.445525 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d67582-cd3b-4de5-8f8b-b5ad8ccd618b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:12.451914 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 326/664] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:57:12 2022] GET /identity/v3/role_assignments?user.id=f446e118975f44b4b31511302a7af36e&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:12.472780 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d67582-cd3b-4de5-8f8b-b5ad8ccd618b None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:12.551241 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:12.587200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d785ef-1eaf-46c7-941e-f3502a5ff0dd None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:12.611588 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d67582-cd3b-4de5-8f8b-b5ad8ccd618b None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:12.631167 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f829e4-995b-46e4-b5e1-58cd5fe55a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:12.632099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f829e4-995b-46e4-b5e1-58cd5fe55a1b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.632513 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f829e4-995b-46e4-b5e1-58cd5fe55a1b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.633799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f829e4-995b-46e4-b5e1-58cd5fe55a1b None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.634841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f829e4-995b-46e4-b5e1-58cd5fe55a1b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:12.635369 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f829e4-995b-46e4-b5e1-58cd5fe55a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:12.637604 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f829e4-995b-46e4-b5e1-58cd5fe55a1b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:12.649955 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 339/665] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jun 6 06:57:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:12.666463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2cec7-0012-41cb-a215-61b1e9bf4598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:12.668294 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2cec7-0012-41cb-a215-61b1e9bf4598 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.668809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2cec7-0012-41cb-a215-61b1e9bf4598 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.669088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2cec7-0012-41cb-a215-61b1e9bf4598 None admin] PATH_INFO: `/v3/services/network` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.673961 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2cec7-0012-41cb-a215-61b1e9bf4598 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:12.675772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2cec7-0012-41cb-a215-61b1e9bf4598 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-b9a2cec7-0012-41cb-a215-61b1e9bf4598 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:12.692731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:12.693818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:12.699496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 327/666] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:12 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:12.702878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f829e4-995b-46e4-b5e1-58cd5fe55a1b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:12.832878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f829e4-995b-46e4-b5e1-58cd5fe55a1b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:12.873529 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51dd85-509c-4d19-b264-6ac56b2c1078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:12.874205 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51dd85-509c-4d19-b264-6ac56b2c1078 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:12.874623 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51dd85-509c-4d19-b264-6ac56b2c1078 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:12.874906 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51dd85-509c-4d19-b264-6ac56b2c1078 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:12.875628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51dd85-509c-4d19-b264-6ac56b2c1078 None admin] RBAC: Adding query filter params (name=network) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:12.875939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51dd85-509c-4d19-b264-6ac56b2c1078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:12.877314 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51dd85-509c-4d19-b264-6ac56b2c1078 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:12.882501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 340/667] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:12.888351 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2cec7-0012-41cb-a215-61b1e9bf4598 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:12.963971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:13.014971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2cec7-0012-41cb-a215-61b1e9bf4598 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:13.054622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c53133-8604-4106-86c3-1cece5f097b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:13.056036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c53133-8604-4106-86c3-1cece5f097b6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:13.056324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c53133-8604-4106-86c3-1cece5f097b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:13.056603 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c53133-8604-4106-86c3-1cece5f097b6 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:13.057322 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c53133-8604-4106-86c3-1cece5f097b6 None admin] RBAC: Adding query filter params (type=network) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:13.057636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c53133-8604-4106-86c3-1cece5f097b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:13.059049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c53133-8604-4106-86c3-1cece5f097b6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:13.070431 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 328/668] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:14.141844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70603e1-6955-43a3-b0a4-846470c132c3 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:14.142376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70603e1-6955-43a3-b0a4-846470c132c3 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:14.142455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70603e1-6955-43a3-b0a4-846470c132c3 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:14.144030 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 341/669] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:14.149971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827e35b-92a5-4439-ad01-499be462507f None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:14.150396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827e35b-92a5-4439-ad01-499be462507f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:14.150575 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827e35b-92a5-4439-ad01-499be462507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:14.167485 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-e827e35b-92a5-4439-ad01-499be462507f None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:14.168609 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-e827e35b-92a5-4439-ad01-499be462507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:14.246548 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 329/670] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:14.270499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70603e1-6955-43a3-b0a4-846470c132c3 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:14.276092 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:14.382772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70603e1-6955-43a3-b0a4-846470c132c3 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:14.422417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4d150-a671-4081-93de-285fda01cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:14.423400 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d150-a671-4081-93de-285fda01cc46 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:14.423863 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d150-a671-4081-93de-285fda01cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:14.424312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d150-a671-4081-93de-285fda01cc46 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:14.425215 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4d150-a671-4081-93de-285fda01cc46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:14.426808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4d150-a671-4081-93de-285fda01cc46 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:14.512064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 342/671] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:57:14 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:57:14.853973 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e4c1d-1975-4c19-9913-a2326064cd6f None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:14.854432 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e4c1d-1975-4c19-9913-a2326064cd6f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:14.854815 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e4c1d-1975-4c19-9913-a2326064cd6f None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:14.856513 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 330/672] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:14.861846 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19312512-fc0c-4073-8ea4-a52ffab088c0 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:14.862219 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19312512-fc0c-4073-8ea4-a52ffab088c0 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:14.862613 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19312512-fc0c-4073-8ea4-a52ffab088c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:14.880545 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-19312512-fc0c-4073-8ea4-a52ffab088c0 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:14.881729 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-19312512-fc0c-4073-8ea4-a52ffab088c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:14.961859 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:14.977928 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 343/673] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:14 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 06 06:57:15.001806 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e4c1d-1975-4c19-9913-a2326064cd6f None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:15.061088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:15.098572 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227c9f3-9a08-404f-967f-662005a2708a None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.099256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227c9f3-9a08-404f-967f-662005a2708a None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.099755 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227c9f3-9a08-404f-967f-662005a2708a None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.101567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 344/674] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:57:15.106759 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbb313-677d-441c-a577-e734b51449f4 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.107271 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbb313-677d-441c-a577-e734b51449f4 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.107770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbb313-677d-441c-a577-e734b51449f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.111189 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e4c1d-1975-4c19-9913-a2326064cd6f None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:15.131017 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-02fbb313-677d-441c-a577-e734b51449f4 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:15.132205 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-02fbb313-677d-441c-a577-e734b51449f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:15.157614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efcf37-6a44-4de9-be51-9f174fd38965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:15.159230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efcf37-6a44-4de9-be51-9f174fd38965 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.159522 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efcf37-6a44-4de9-be51-9f174fd38965 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.160045 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efcf37-6a44-4de9-be51-9f174fd38965 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.175467 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efcf37-6a44-4de9-be51-9f174fd38965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-26efcf37-6a44-4de9-be51-9f174fd38965 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:57:15.186791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:15.187850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:57:15.188718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:15.197010 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 331/675] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:15.199191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efcf37-6a44-4de9-be51-9f174fd38965 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:15.230751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 345/676] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:15 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:57:15.252369 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbb313-677d-441c-a577-e734b51449f4 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:15.308597 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efcf37-6a44-4de9-be51-9f174fd38965 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:15.322775 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:15.344903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758561b-f8e7-425d-bda9-2b9d7e691b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:15.346060 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758561b-f8e7-425d-bda9-2b9d7e691b0e None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.346548 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758561b-f8e7-425d-bda9-2b9d7e691b0e None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.346835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758561b-f8e7-425d-bda9-2b9d7e691b0e None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.347590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758561b-f8e7-425d-bda9-2b9d7e691b0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:15.347926 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758561b-f8e7-425d-bda9-2b9d7e691b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:15.349320 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758561b-f8e7-425d-bda9-2b9d7e691b0e None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:15.358449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 332/677] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:15.365115 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758561b-f8e7-425d-bda9-2b9d7e691b0e None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:15.374602 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbb313-677d-441c-a577-e734b51449f4 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:15.397615 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:15.412356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abf248-0613-4487-aa2a-0b9978e58fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:15.413481 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abf248-0613-4487-aa2a-0b9978e58fb1 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.413765 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abf248-0613-4487-aa2a-0b9978e58fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.414040 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abf248-0613-4487-aa2a-0b9978e58fb1 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.414904 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abf248-0613-4487-aa2a-0b9978e58fb1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:15.416358 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abf248-0613-4487-aa2a-0b9978e58fb1 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:15.484137 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 346/678] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:57:15 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:57:15.500139 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758561b-f8e7-425d-bda9-2b9d7e691b0e None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:15.525288 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e8cb7-e8df-402c-a786-8ebd8dce30e4 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.525597 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e8cb7-e8df-402c-a786-8ebd8dce30e4 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.525929 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e8cb7-e8df-402c-a786-8ebd8dce30e4 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.527396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 347/679] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:57:15.533163 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a851-ed23-4e4f-a062-1f1595f5a19a None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.533481 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a851-ed23-4e4f-a062-1f1595f5a19a None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.533739 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a851-ed23-4e4f-a062-1f1595f5a19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.553119 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-4c28a851-ed23-4e4f-a062-1f1595f5a19a None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:15.554466 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-4c28a851-ed23-4e4f-a062-1f1595f5a19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:15.559957 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322faabc-01b1-485f-a647-8d3491b4adc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:15.561119 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322faabc-01b1-485f-a647-8d3491b4adc8 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.561593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322faabc-01b1-485f-a647-8d3491b4adc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.562087 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322faabc-01b1-485f-a647-8d3491b4adc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.578665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322faabc-01b1-485f-a647-8d3491b4adc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:15.581341 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322faabc-01b1-485f-a647-8d3491b4adc8 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-322faabc-01b1-485f-a647-8d3491b4adc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:15.606528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:15.607509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:15.608396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:15.608396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:15.608396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:15.608396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:15.616062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 333/680] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:15.616761 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322faabc-01b1-485f-a647-8d3491b4adc8 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:15.662358 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 348/681] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:15 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 06 06:57:15.662566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:15.679189 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a851-ed23-4e4f-a062-1f1595f5a19a None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:15.763955 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322faabc-01b1-485f-a647-8d3491b4adc8 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:15.810544 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c305f-7f89-46aa-bab2-87a93eb63cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:15.812238 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c305f-7f89-46aa-bab2-87a93eb63cc4 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.812731 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c305f-7f89-46aa-bab2-87a93eb63cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.813209 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c305f-7f89-46aa-bab2-87a93eb63cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.813850 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a851-ed23-4e4f-a062-1f1595f5a19a None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:15.814376 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c305f-7f89-46aa-bab2-87a93eb63cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:15.814903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c305f-7f89-46aa-bab2-87a93eb63cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:15.817624 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c305f-7f89-46aa-bab2-87a93eb63cc4 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:15.825531 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:15.833791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 334/682] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:15.839901 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c305f-7f89-46aa-bab2-87a93eb63cc4 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:15.855532 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dbd2a-7a82-47da-ad32-a667d510941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:15.856435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dbd2a-7a82-47da-ad32-a667d510941a None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:15.856874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dbd2a-7a82-47da-ad32-a667d510941a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:15.857248 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dbd2a-7a82-47da-ad32-a667d510941a None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:15.858128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dbd2a-7a82-47da-ad32-a667d510941a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:15.859846 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dbd2a-7a82-47da-ad32-a667d510941a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:15.942402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 349/683] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:57:15 2022] POST /identity/v3/services => generated 240 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:57:15.950094 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:15.988164 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c305f-7f89-46aa-bab2-87a93eb63cc4 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:16.034992 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59085e-7bbd-47bf-bfe3-4ea0c72c5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:16.035799 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59085e-7bbd-47bf-bfe3-4ea0c72c5a68 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:16.036089 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59085e-7bbd-47bf-bfe3-4ea0c72c5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:16.036368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59085e-7bbd-47bf-bfe3-4ea0c72c5a68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:16.044930 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59085e-7bbd-47bf-bfe3-4ea0c72c5a68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:16.046439 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59085e-7bbd-47bf-bfe3-4ea0c72c5a68 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-ea59085e-7bbd-47bf-bfe3-4ea0c72c5a68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:16.063054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:16.064093 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:16.065659 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 335/684] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jun 6 06:57:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:16.070314 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dbd2a-7a82-47da-ad32-a667d510941a None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:16.187462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dbd2a-7a82-47da-ad32-a667d510941a None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:16.224079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1059304-08e0-44be-bd70-205df918720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:16.225116 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1059304-08e0-44be-bd70-205df918720d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:16.225634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1059304-08e0-44be-bd70-205df918720d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:16.226121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1059304-08e0-44be-bd70-205df918720d None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:16.228630 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1059304-08e0-44be-bd70-205df918720d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:16.229188 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1059304-08e0-44be-bd70-205df918720d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:16.230937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1059304-08e0-44be-bd70-205df918720d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:16.258876 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 350/685] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jun 6 06:57:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:16.264240 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59085e-7bbd-47bf-bfe3-4ea0c72c5a68 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:16.370677 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59085e-7bbd-47bf-bfe3-4ea0c72c5a68 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:16.406949 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6f09c-8979-43e5-a7c9-bdbc002d3060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:16.407747 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6f09c-8979-43e5-a7c9-bdbc002d3060 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:16.408032 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6f09c-8979-43e5-a7c9-bdbc002d3060 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:16.408311 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6f09c-8979-43e5-a7c9-bdbc002d3060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:16.415451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:16.419405 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6f09c-8979-43e5-a7c9-bdbc002d3060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:16.421168 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6f09c-8979-43e5-a7c9-bdbc002d3060 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-89d6f09c-8979-43e5-a7c9-bdbc002d3060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:16.438933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:16.440057 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:16.441182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:16.441182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:16.441182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:16.441182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:16.441953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 336/686] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:16.447763 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1059304-08e0-44be-bd70-205df918720d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:16.477812 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:16.551416 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1059304-08e0-44be-bd70-205df918720d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:16.589512 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f3cc-ff84-43a8-96ed-c9f854f612fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:16.590262 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f3cc-ff84-43a8-96ed-c9f854f612fa None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:16.590637 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f3cc-ff84-43a8-96ed-c9f854f612fa None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:16.590976 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615f3cc-ff84-43a8-96ed-c9f854f612fa None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:16.591771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615f3cc-ff84-43a8-96ed-c9f854f612fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:16.592144 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615f3cc-ff84-43a8-96ed-c9f854f612fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:16.593632 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615f3cc-ff84-43a8-96ed-c9f854f612fa None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:16.607004 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 351/687] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:16.612791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6f09c-8979-43e5-a7c9-bdbc002d3060 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:16.721011 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6f09c-8979-43e5-a7c9-bdbc002d3060 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:16.756774 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2cbb4-d70f-4404-a801-c847c5e8cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:16.757657 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2cbb4-d70f-4404-a801-c847c5e8cd21 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:16.758007 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2cbb4-d70f-4404-a801-c847c5e8cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:16.759096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2cbb4-d70f-4404-a801-c847c5e8cd21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:16.766670 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2cbb4-d70f-4404-a801-c847c5e8cd21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:16.768187 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2cbb4-d70f-4404-a801-c847c5e8cd21 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-6ef2cbb4-d70f-4404-a801-c847c5e8cd21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:16.782389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:16.783500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:16.784600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:16.784600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:16.784600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:16.784600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:16.784600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:16.784600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:16.784600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:16.784600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:16.786377 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 337/688] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:16.791127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f3cc-ff84-43a8-96ed-c9f854f612fa None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:16.883060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:16.895688 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615f3cc-ff84-43a8-96ed-c9f854f612fa None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:16.934708 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3929d41-7296-40bd-949d-881d7da03fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:16.935465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3929d41-7296-40bd-949d-881d7da03fd4 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:16.935817 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3929d41-7296-40bd-949d-881d7da03fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:16.936162 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3929d41-7296-40bd-949d-881d7da03fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:16.937022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3929d41-7296-40bd-949d-881d7da03fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:16.937397 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3929d41-7296-40bd-949d-881d7da03fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:16.938937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3929d41-7296-40bd-949d-881d7da03fd4 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:16.952372 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 352/689] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:16.957720 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410c4a-e845-4539-9c49-7181925a9915 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:16.958085 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410c4a-e845-4539-9c49-7181925a9915 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:16.958456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410c4a-e845-4539-9c49-7181925a9915 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:16.960282 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 338/690] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:16.960594 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3929d41-7296-40bd-949d-881d7da03fd4 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:16.965983 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5321-ed94-491d-86b1-917e38b9d42d None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:16.966277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5321-ed94-491d-86b1-917e38b9d42d None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:16.966696 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5321-ed94-491d-86b1-917e38b9d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:16.983991 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-28cf5321-ed94-491d-86b1-917e38b9d42d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:16.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-28cf5321-ed94-491d-86b1-917e38b9d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:17.046715 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:17.064988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 339/691] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:16 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:57:17.086638 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3929d41-7296-40bd-949d-881d7da03fd4 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:17.088865 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf5321-ed94-491d-86b1-917e38b9d42d None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:17.130358 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71116e74-2905-488a-b86b-dab6f58a9617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:17.132406 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71116e74-2905-488a-b86b-dab6f58a9617 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:17.132845 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71116e74-2905-488a-b86b-dab6f58a9617 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:17.133297 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71116e74-2905-488a-b86b-dab6f58a9617 None admin] PATH_INFO: `/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/f446e118975f44b4b31511302a7af36e/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:17.136172 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71116e74-2905-488a-b86b-dab6f58a9617 None admin] RBAC: Authorizing `identity:create_grant(project_id=518ead35f9cb42f7b67bbe66e16c3236, user_id=f446e118975f44b4b31511302a7af36e, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:17.138641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71116e74-2905-488a-b86b-dab6f58a9617 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:17.193280 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf5321-ed94-491d-86b1-917e38b9d42d None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:17.215153 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 353/692] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:57:16 2022] PUT /identity/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/f446e118975f44b4b31511302a7af36e/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:57:17.244064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ba8f-729a-4c04-b52b-b4edac1419de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:17.245502 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ba8f-729a-4c04-b52b-b4edac1419de None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:17.246391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ba8f-729a-4c04-b52b-b4edac1419de None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:17.246917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ba8f-729a-4c04-b52b-b4edac1419de None admin] PATH_INFO: `/v3/services/image` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:17.247925 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ba8f-729a-4c04-b52b-b4edac1419de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:17.249789 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ba8f-729a-4c04-b52b-b4edac1419de None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-9254ba8f-729a-4c04-b52b-b4edac1419de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:17.264451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:17.265946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 06:57:17.266814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:17.270496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 340/693] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Jun 6 06:57:17 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:17.276835 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71116e74-2905-488a-b86b-dab6f58a9617 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:17.290750 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:17.396725 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71116e74-2905-488a-b86b-dab6f58a9617 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:17.435374 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dcb54-44fc-4516-831a-869832f6c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:17.436059 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dcb54-44fc-4516-831a-869832f6c657 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:17.436350 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dcb54-44fc-4516-831a-869832f6c657 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:17.436642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dcb54-44fc-4516-831a-869832f6c657 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:17.437365 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dcb54-44fc-4516-831a-869832f6c657 None admin] RBAC: Adding query filter params (name=image) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:17.437680 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dcb54-44fc-4516-831a-869832f6c657 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:17.439106 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dcb54-44fc-4516-831a-869832f6c657 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:17.444051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 354/694] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:17.450368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ba8f-729a-4c04-b52b-b4edac1419de None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:17.505770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:17.567221 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ba8f-729a-4c04-b52b-b4edac1419de None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:17.608903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c70b3-4316-494f-aeec-8aaa251930bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:17.610416 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c70b3-4316-494f-aeec-8aaa251930bc None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:17.610416 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c70b3-4316-494f-aeec-8aaa251930bc None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:17.610416 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c70b3-4316-494f-aeec-8aaa251930bc None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:17.613895 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c70b3-4316-494f-aeec-8aaa251930bc None admin] RBAC: Adding query filter params (type=image) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:17.613895 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c70b3-4316-494f-aeec-8aaa251930bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:17.613895 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c70b3-4316-494f-aeec-8aaa251930bc None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:17.618618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 341/695] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:17.624018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dcb54-44fc-4516-831a-869832f6c657 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:17.696847 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:17.728197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dcb54-44fc-4516-831a-869832f6c657 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:17.767738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f95a0-3022-4cfa-8265-20b16aa7077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:17.768323 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f95a0-3022-4cfa-8265-20b16aa7077a None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:17.768608 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f95a0-3022-4cfa-8265-20b16aa7077a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:17.768888 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f95a0-3022-4cfa-8265-20b16aa7077a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:17.769680 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f95a0-3022-4cfa-8265-20b16aa7077a None admin] RBAC: Adding query filter params (interface=public, service_id=77eb1bd1196c425aa136001d26b250ec, region_id=RegionOne) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:17.769994 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f95a0-3022-4cfa-8265-20b16aa7077a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:17.771531 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f95a0-3022-4cfa-8265-20b16aa7077a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:17.781143 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 355/696] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jun 6 06:57:17 2022] GET /identity/v3/endpoints?service_id=77eb1bd1196c425aa136001d26b250ec&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:17.786195 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c70b3-4316-494f-aeec-8aaa251930bc None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:17.896379 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c70b3-4316-494f-aeec-8aaa251930bc None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:17.906200 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:17.913791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926cea-6a4e-415c-9370-ca3dbff7d027 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:17.913791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926cea-6a4e-415c-9370-ca3dbff7d027 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:17.913941 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926cea-6a4e-415c-9370-ca3dbff7d027 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:17.915531 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 356/697] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:17.920863 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee63ea-3db9-4eb1-b9d1-8fc9a1824999 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:17.921326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee63ea-3db9-4eb1-b9d1-8fc9a1824999 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:17.922111 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee63ea-3db9-4eb1-b9d1-8fc9a1824999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:17.941376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-17ee63ea-3db9-4eb1-b9d1-8fc9a1824999 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:17.942298 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3136085-8576-4672-98b9-10627f191aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:17.943034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-17ee63ea-3db9-4eb1-b9d1-8fc9a1824999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:17.943178 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136085-8576-4672-98b9-10627f191aeb None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:17.943548 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136085-8576-4672-98b9-10627f191aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:17.943906 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136085-8576-4672-98b9-10627f191aeb None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:17.944728 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3136085-8576-4672-98b9-10627f191aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:17.947042 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3136085-8576-4672-98b9-10627f191aeb None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:17.958542 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 342/698] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jun 6 06:57:17 2022] GET /identity/v3/services => generated 1002 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 06:57:18.026028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 357/699] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:57:18.050781 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3136085-8576-4672-98b9-10627f191aeb None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:18.161678 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3136085-8576-4672-98b9-10627f191aeb None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:18.199668 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188b4f1-d947-4fe0-ae69-f3c31c6bb266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:18.200818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b4f1-d947-4fe0-ae69-f3c31c6bb266 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:18.201261 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b4f1-d947-4fe0-ae69-f3c31c6bb266 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:18.201694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b4f1-d947-4fe0-ae69-f3c31c6bb266 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:18.202577 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188b4f1-d947-4fe0-ae69-f3c31c6bb266 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:18.204170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188b4f1-d947-4fe0-ae69-f3c31c6bb266 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-4188b4f1-d947-4fe0-ae69-f3c31c6bb266 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:18.217759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:18.219004 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 06:57:18.220052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:18.222805 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 343/700] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Jun 6 06:57:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:18.229240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee63ea-3db9-4eb1-b9d1-8fc9a1824999 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:18.297862 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:18.338432 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee63ea-3db9-4eb1-b9d1-8fc9a1824999 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:18.378687 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4b477-093b-49e0-806c-4d8d3e24abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:18.379358 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4b477-093b-49e0-806c-4d8d3e24abaf None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:18.379640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4b477-093b-49e0-806c-4d8d3e24abaf None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:18.379914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4b477-093b-49e0-806c-4d8d3e24abaf None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:18.380630 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4b477-093b-49e0-806c-4d8d3e24abaf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:18.380937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4b477-093b-49e0-806c-4d8d3e24abaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:18.382340 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4b477-093b-49e0-806c-4d8d3e24abaf None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:18.388083 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 358/701] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jun 6 06:57:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:18.395413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188b4f1-d947-4fe0-ae69-f3c31c6bb266 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:18.434014 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:18.504715 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188b4f1-d947-4fe0-ae69-f3c31c6bb266 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:18.541962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448b7b3-8793-42b6-85ba-dcca9b0671ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:18.543034 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b7b3-8793-42b6-85ba-dcca9b0671ff None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:18.543529 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b7b3-8793-42b6-85ba-dcca9b0671ff None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:18.544033 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b7b3-8793-42b6-85ba-dcca9b0671ff None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:18.544946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448b7b3-8793-42b6-85ba-dcca9b0671ff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:18.545458 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448b7b3-8793-42b6-85ba-dcca9b0671ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:18.547268 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448b7b3-8793-42b6-85ba-dcca9b0671ff None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:18.553246 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 344/702] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jun 6 06:57:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:18.557808 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9f938-8135-4cdb-937b-25cf3b794eb0 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:18.558102 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9f938-8135-4cdb-937b-25cf3b794eb0 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:18.558417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9f938-8135-4cdb-937b-25cf3b794eb0 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:18.560412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448b7b3-8793-42b6-85ba-dcca9b0671ff None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:18.562989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 359/703] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:18.565377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7929-b4cd-493b-8e25-5137ea559350 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:18.565673 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7929-b4cd-493b-8e25-5137ea559350 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:18.565963 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7929-b4cd-493b-8e25-5137ea559350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:18.586643 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-ddbe7929-b4cd-493b-8e25-5137ea559350 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:18.587887 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-ddbe7929-b4cd-493b-8e25-5137ea559350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:18.663079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 360/704] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:18.679040 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:18.682943 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448b7b3-8793-42b6-85ba-dcca9b0671ff None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:18.687606 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe7929-b4cd-493b-8e25-5137ea559350 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:18.719335 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ca11a-618d-4847-8e87-703be8e0a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:18.720078 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ca11a-618d-4847-8e87-703be8e0a47c None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:18.721146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ca11a-618d-4847-8e87-703be8e0a47c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:18.721489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ca11a-618d-4847-8e87-703be8e0a47c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:18.722363 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ca11a-618d-4847-8e87-703be8e0a47c None admin] RBAC: Adding query filter params (interface=public, service_id=85f1e98c3da84a9cae4cb2694895ba87, region_id=RegionOne) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:18.722753 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ca11a-618d-4847-8e87-703be8e0a47c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:18.724315 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ca11a-618d-4847-8e87-703be8e0a47c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:18.733260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 345/705] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jun 6 06:57:18 2022] GET /identity/v3/endpoints?service_id=85f1e98c3da84a9cae4cb2694895ba87&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:18.738651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ca11a-618d-4847-8e87-703be8e0a47c None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:18.754894 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:18.799780 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe7929-b4cd-493b-8e25-5137ea559350 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:18.837574 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ff04-f7bc-4b4a-a0a0-b42d3de7e34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:18.838698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ff04-f7bc-4b4a-a0a0-b42d3de7e34e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:18.839054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ff04-f7bc-4b4a-a0a0-b42d3de7e34e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:18.839404 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ff04-f7bc-4b4a-a0a0-b42d3de7e34e None admin] PATH_INFO: `/v3/services/network` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:18.840139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ff04-f7bc-4b4a-a0a0-b42d3de7e34e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:18.841720 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ff04-f7bc-4b4a-a0a0-b42d3de7e34e None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:18.851607 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ca11a-618d-4847-8e87-703be8e0a47c None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-1621ff04-f7bc-4b4a-a0a0-b42d3de7e34e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:18.855357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:18.856567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 06:57:18.857596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:18.863488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 361/706] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:18 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:18.864746 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ff04-f7bc-4b4a-a0a0-b42d3de7e34e None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:18.893767 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00644c-c0c0-4bcb-8983-b7b5f4ed3273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:18.894981 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00644c-c0c0-4bcb-8983-b7b5f4ed3273 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:18.895693 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00644c-c0c0-4bcb-8983-b7b5f4ed3273 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:18.896125 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00644c-c0c0-4bcb-8983-b7b5f4ed3273 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:18.897506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00644c-c0c0-4bcb-8983-b7b5f4ed3273 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:18.900008 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00644c-c0c0-4bcb-8983-b7b5f4ed3273 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:18.925121 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 346/707] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jun 6 06:57:18 2022] GET /identity/v3/services => generated 1002 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 06:57:18.993734 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ff04-f7bc-4b4a-a0a0-b42d3de7e34e None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:19.020366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:19.033146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae64f-9ea9-402a-94ae-f9cb37f6f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:19.034024 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae64f-9ea9-402a-94ae-f9cb37f6f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:19.034539 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae64f-9ea9-402a-94ae-f9cb37f6f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:19.034926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae64f-9ea9-402a-94ae-f9cb37f6f4d5 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:19.035768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ae64f-9ea9-402a-94ae-f9cb37f6f4d5 None admin] RBAC: Adding query filter params (name=network) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:19.036186 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ae64f-9ea9-402a-94ae-f9cb37f6f4d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:19.037709 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ae64f-9ea9-402a-94ae-f9cb37f6f4d5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:19.048606 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 362/708] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:19.050203 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00644c-c0c0-4bcb-8983-b7b5f4ed3273 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:19.081939 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:19.168657 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00644c-c0c0-4bcb-8983-b7b5f4ed3273 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:19.205310 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdde77-fa00-40ef-bcf9-d9d0053a13f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:19.206005 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdde77-fa00-40ef-bcf9-d9d0053a13f2 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:19.206293 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdde77-fa00-40ef-bcf9-d9d0053a13f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:19.206610 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdde77-fa00-40ef-bcf9-d9d0053a13f2 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:19.207355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdde77-fa00-40ef-bcf9-d9d0053a13f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:19.207668 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdde77-fa00-40ef-bcf9-d9d0053a13f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:19.209116 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdde77-fa00-40ef-bcf9-d9d0053a13f2 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:19.216084 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 347/709] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:19.222669 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae64f-9ea9-402a-94ae-f9cb37f6f4d5 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:19.341850 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae64f-9ea9-402a-94ae-f9cb37f6f4d5 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:19.380182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6d7e-274e-4d26-9f24-6d7048193dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:19.380904 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6d7e-274e-4d26-9f24-6d7048193dfb None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:19.381201 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6d7e-274e-4d26-9f24-6d7048193dfb None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:19.381478 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6d7e-274e-4d26-9f24-6d7048193dfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:19.382282 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6d7e-274e-4d26-9f24-6d7048193dfb None admin] RBAC: Adding query filter params (interface=public, service_id=6d1e1cc80f1c467d989e6d075c9ac6be, region_id=RegionOne) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:19.382696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6d7e-274e-4d26-9f24-6d7048193dfb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:19.384084 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6d7e-274e-4d26-9f24-6d7048193dfb None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:19.390000 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 363/710] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jun 6 06:57:19 2022] GET /identity/v3/endpoints?service_id=6d1e1cc80f1c467d989e6d075c9ac6be&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:19.395730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdde77-fa00-40ef-bcf9-d9d0053a13f2 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:19.501076 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:19.511609 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdde77-fa00-40ef-bcf9-d9d0053a13f2 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:19.549365 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b98aee-837c-429e-9a44-baa5545dfa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:19.550424 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98aee-837c-429e-9a44-baa5545dfa23 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:19.550895 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98aee-837c-429e-9a44-baa5545dfa23 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:19.551345 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98aee-837c-429e-9a44-baa5545dfa23 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:19.552204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b98aee-837c-429e-9a44-baa5545dfa23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:19.553743 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b98aee-837c-429e-9a44-baa5545dfa23 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:19.564357 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 348/711] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jun 6 06:57:19 2022] GET /identity/v3/services => generated 1002 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 06:57:19.670663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e102-2fae-4f93-9808-217b3fca3e0f None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:19.671016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e102-2fae-4f93-9808-217b3fca3e0f None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:19.671243 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e102-2fae-4f93-9808-217b3fca3e0f None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:19.672891 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 364/712] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:19.680723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253385-47ad-49c0-872e-ba96cec5bbba None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:19.681172 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253385-47ad-49c0-872e-ba96cec5bbba None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:19.681574 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253385-47ad-49c0-872e-ba96cec5bbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:19.700204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-d8253385-47ad-49c0-872e-ba96cec5bbba None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:19.701452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-d8253385-47ad-49c0-872e-ba96cec5bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:19.778262 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 349/713] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:19.802754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1e102-2fae-4f93-9808-217b3fca3e0f None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:19.870857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:19.929573 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1e102-2fae-4f93-9808-217b3fca3e0f None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:19.969108 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80877a-7f07-4979-b5a9-b4af470f1925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:19.969914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80877a-7f07-4979-b5a9-b4af470f1925 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:19.970201 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80877a-7f07-4979-b5a9-b4af470f1925 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:19.970517 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80877a-7f07-4979-b5a9-b4af470f1925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:19.981722 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80877a-7f07-4979-b5a9-b4af470f1925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-4c80877a-7f07-4979-b5a9-b4af470f1925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:57:19.989302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:19.990252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:19.991580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 365/714] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:57:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:19.997206 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253385-47ad-49c0-872e-ba96cec5bbba None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:20.096240 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:20.113795 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253385-47ad-49c0-872e-ba96cec5bbba None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:20.152310 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49eec4-7a73-4812-aa85-a587d461aa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:20.153419 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49eec4-7a73-4812-aa85-a587d461aa42 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:20.153923 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49eec4-7a73-4812-aa85-a587d461aa42 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:20.154500 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49eec4-7a73-4812-aa85-a587d461aa42 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:20.155552 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49eec4-7a73-4812-aa85-a587d461aa42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:20.156086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49eec4-7a73-4812-aa85-a587d461aa42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:20.157747 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49eec4-7a73-4812-aa85-a587d461aa42 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:20.169113 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 350/715] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:57:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:20.174373 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80877a-7f07-4979-b5a9-b4af470f1925 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:20.281705 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80877a-7f07-4979-b5a9-b4af470f1925 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:20.296723 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:20.322848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7314f9a-0454-49cc-b87b-b53be5d2d580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:20.323704 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314f9a-0454-49cc-b87b-b53be5d2d580 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:20.324045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314f9a-0454-49cc-b87b-b53be5d2d580 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:20.324329 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314f9a-0454-49cc-b87b-b53be5d2d580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:20.335707 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314f9a-0454-49cc-b87b-b53be5d2d580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:20.337220 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314f9a-0454-49cc-b87b-b53be5d2d580 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-b7314f9a-0454-49cc-b87b-b53be5d2d580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:20.355459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:20.356775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:20.358252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:20.358252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:20.358252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:20.358252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:20.358252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 366/716] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:20.362604 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49eec4-7a73-4812-aa85-a587d461aa42 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:20.429807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cea2a8-ee71-4bee-bc3e-9d0f588e5066 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:20.430165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cea2a8-ee71-4bee-bc3e-9d0f588e5066 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:20.430435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cea2a8-ee71-4bee-bc3e-9d0f588e5066 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:20.432043 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 367/717] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:57:20.436959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebab7ee-8202-4cf9-bd5c-64a32923abd9 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:20.437304 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebab7ee-8202-4cf9-bd5c-64a32923abd9 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:20.437534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebab7ee-8202-4cf9-bd5c-64a32923abd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:20.454930 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-1ebab7ee-8202-4cf9-bd5c-64a32923abd9 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:20.456116 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-1ebab7ee-8202-4cf9-bd5c-64a32923abd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:20.473210 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49eec4-7a73-4812-aa85-a587d461aa42 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:20.511894 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3ae3d-ce7d-40f2-a193-3bca1ca511e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:20.513026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3ae3d-ce7d-40f2-a193-3bca1ca511e7 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:20.513619 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3ae3d-ce7d-40f2-a193-3bca1ca511e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:20.514125 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3ae3d-ce7d-40f2-a193-3bca1ca511e7 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:20.515120 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3ae3d-ce7d-40f2-a193-3bca1ca511e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:20.515759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3ae3d-ce7d-40f2-a193-3bca1ca511e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:20.517437 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3ae3d-ce7d-40f2-a193-3bca1ca511e7 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:20.532131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 351/718] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:20.542565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 368/719] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:20.543660 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3ae3d-ce7d-40f2-a193-3bca1ca511e7 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:20.555064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:20.565352 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebab7ee-8202-4cf9-bd5c-64a32923abd9 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:20.671684 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3ae3d-ce7d-40f2-a193-3bca1ca511e7 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:20.683345 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:20.690506 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebab7ee-8202-4cf9-bd5c-64a32923abd9 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:20.718845 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ace853-a0a8-4132-915e-090d8bdf9e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:20.720044 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ace853-a0a8-4132-915e-090d8bdf9e20 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:20.720577 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ace853-a0a8-4132-915e-090d8bdf9e20 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:20.721055 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ace853-a0a8-4132-915e-090d8bdf9e20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:20.730388 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6a9af-5089-4554-af97-b7900104cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:20.730897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ace853-a0a8-4132-915e-090d8bdf9e20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:20.731292 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6a9af-5089-4554-af97-b7900104cac9 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:20.731577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6a9af-5089-4554-af97-b7900104cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:20.731855 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6a9af-5089-4554-af97-b7900104cac9 None admin] PATH_INFO: `/v3/services/image` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:20.732515 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6a9af-5089-4554-af97-b7900104cac9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:20.733447 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ace853-a0a8-4132-915e-090d8bdf9e20 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:20.733887 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6a9af-5089-4554-af97-b7900104cac9 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-a8a6a9af-5089-4554-af97-b7900104cac9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:20.747224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:20.748242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:20.749073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 369/720] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Jun 6 06:57:20 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-21ace853-a0a8-4132-915e-090d8bdf9e20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:20.756569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:20.757490 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:20.759539 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 352/721] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Jun 6 06:57:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:20.760136 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6a9af-5089-4554-af97-b7900104cac9 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:20.765799 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ace853-a0a8-4132-915e-090d8bdf9e20 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:20.847314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:20.882122 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6a9af-5089-4554-af97-b7900104cac9 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:20.894804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ace853-a0a8-4132-915e-090d8bdf9e20 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:20.931125 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808709-ceda-485b-9d5e-01f956f83700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:20.931696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808709-ceda-485b-9d5e-01f956f83700 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:20.931994 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808709-ceda-485b-9d5e-01f956f83700 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:20.932286 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808709-ceda-485b-9d5e-01f956f83700 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:20.933054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0808709-ceda-485b-9d5e-01f956f83700 None admin] RBAC: Adding query filter params (name=image) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:20.933317 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0808709-ceda-485b-9d5e-01f956f83700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:20.934724 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0808709-ceda-485b-9d5e-01f956f83700 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:20.939428 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ff557-001f-4e14-8116-77d29cdd7876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:20.940150 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 370/722] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:20.940544 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ff557-001f-4e14-8116-77d29cdd7876 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:20.940932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ff557-001f-4e14-8116-77d29cdd7876 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:20.941223 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ff557-001f-4e14-8116-77d29cdd7876 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:20.942070 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ff557-001f-4e14-8116-77d29cdd7876 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:20.942508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ff557-001f-4e14-8116-77d29cdd7876 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:20.943877 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ff557-001f-4e14-8116-77d29cdd7876 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:20.945363 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808709-ceda-485b-9d5e-01f956f83700 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:20.974437 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 353/723] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Jun 6 06:57:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:20.976396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ff557-001f-4e14-8116-77d29cdd7876 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:20.979821 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:21.073897 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808709-ceda-485b-9d5e-01f956f83700 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:21.110260 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098650e-8f01-4b01-aac7-34e073da6660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:21.110914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098650e-8f01-4b01-aac7-34e073da6660 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.111204 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098650e-8f01-4b01-aac7-34e073da6660 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.111485 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098650e-8f01-4b01-aac7-34e073da6660 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.112199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098650e-8f01-4b01-aac7-34e073da6660 None admin] RBAC: Adding query filter params (type=image) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:21.112509 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098650e-8f01-4b01-aac7-34e073da6660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:21.113886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098650e-8f01-4b01-aac7-34e073da6660 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:21.119903 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 371/724] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:21.121883 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ff557-001f-4e14-8116-77d29cdd7876 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:21.131975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098650e-8f01-4b01-aac7-34e073da6660 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:21.156356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:21.166044 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309643bd-321e-4a17-9e4d-917c488650c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:21.166748 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309643bd-321e-4a17-9e4d-917c488650c5 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.167038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309643bd-321e-4a17-9e4d-917c488650c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.167322 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309643bd-321e-4a17-9e4d-917c488650c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.214948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:21.229883 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098650e-8f01-4b01-aac7-34e073da6660 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:21.243700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309643bd-321e-4a17-9e4d-917c488650c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:21.245344 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309643bd-321e-4a17-9e4d-917c488650c5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:21.267220 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf47ff-eb61-4479-a82a-85696254efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:21.267883 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf47ff-eb61-4479-a82a-85696254efca None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.268365 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf47ff-eb61-4479-a82a-85696254efca None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.268650 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf47ff-eb61-4479-a82a-85696254efca None admin] PATH_INFO: `/v3/endpoints` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.269411 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf47ff-eb61-4479-a82a-85696254efca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:21.271049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf47ff-eb61-4479-a82a-85696254efca None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:21.359742 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 354/725] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:57:20 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 06 06:57:21.361890 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309643bd-321e-4a17-9e4d-917c488650c5 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:21.364518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 372/726] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jun 6 06:57:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:57:21.368454 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0da8-f03a-49a1-8c2a-fd79e18d9485 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.368756 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0da8-f03a-49a1-8c2a-fd79e18d9485 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.369039 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0da8-f03a-49a1-8c2a-fd79e18d9485 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.370582 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 373/727] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:21.380966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295944bc-4f28-43c8-8d2e-9881b7a092ec None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.381616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295944bc-4f28-43c8-8d2e-9881b7a092ec None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.382108 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295944bc-4f28-43c8-8d2e-9881b7a092ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.397208 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:21.411533 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-295944bc-4f28-43c8-8d2e-9881b7a092ec None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:21.421272 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-295944bc-4f28-43c8-8d2e-9881b7a092ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:21.489933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309643bd-321e-4a17-9e4d-917c488650c5 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:21.526487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 374/728] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:21 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:21.534912 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bdc6c-4bf2-43f6-8616-e52ee690c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:21.536095 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bdc6c-4bf2-43f6-8616-e52ee690c085 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.536595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bdc6c-4bf2-43f6-8616-e52ee690c085 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.537053 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bdc6c-4bf2-43f6-8616-e52ee690c085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.549415 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bdc6c-4bf2-43f6-8616-e52ee690c085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:21.549751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295944bc-4f28-43c8-8d2e-9881b7a092ec None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:21.551486 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bdc6c-4bf2-43f6-8616-e52ee690c085 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-0d8bdc6c-4bf2-43f6-8616-e52ee690c085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:21.571579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:21.572579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:21.573577 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:21.573577 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:21.573577 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:21.573577 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:21.575990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 355/729] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:21.581183 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bdc6c-4bf2-43f6-8616-e52ee690c085 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:21.635531 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:21.678690 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295944bc-4f28-43c8-8d2e-9881b7a092ec None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:21.702738 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:21.709054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bdc6c-4bf2-43f6-8616-e52ee690c085 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:21.724916 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd034d0f-f164-475d-8045-f43ecbccd0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:21.725784 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd034d0f-f164-475d-8045-f43ecbccd0e2 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.726070 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd034d0f-f164-475d-8045-f43ecbccd0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.726376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd034d0f-f164-475d-8045-f43ecbccd0e2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.727111 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd034d0f-f164-475d-8045-f43ecbccd0e2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:21.728803 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd034d0f-f164-475d-8045-f43ecbccd0e2 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-dd034d0f-f164-475d-8045-f43ecbccd0e2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:21.746540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:21.747607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:21.748544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 375/730] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Jun 6 06:57:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:21.754428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd034d0f-f164-475d-8045-f43ecbccd0e2 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:21.760948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb877e8-9a72-4c67-9e1e-ab196329fc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:21.761902 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb877e8-9a72-4c67-9e1e-ab196329fc5a None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.762428 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb877e8-9a72-4c67-9e1e-ab196329fc5a None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.762911 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb877e8-9a72-4c67-9e1e-ab196329fc5a None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.763839 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb877e8-9a72-4c67-9e1e-ab196329fc5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:21.764393 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb877e8-9a72-4c67-9e1e-ab196329fc5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:21.766108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb877e8-9a72-4c67-9e1e-ab196329fc5a None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:21.781341 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 356/731] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:21.786925 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb877e8-9a72-4c67-9e1e-ab196329fc5a None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:21.898765 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb877e8-9a72-4c67-9e1e-ab196329fc5a None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:21.900471 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd034d0f-f164-475d-8045-f43ecbccd0e2 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:21.948472 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0ee50-f5b3-4d84-9336-a1ccf0b7a05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:21.949278 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ee50-f5b3-4d84-9336-a1ccf0b7a05c None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.949570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ee50-f5b3-4d84-9336-a1ccf0b7a05c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.949851 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ee50-f5b3-4d84-9336-a1ccf0b7a05c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.951252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:21.958005 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b9115-3479-4533-9e81-02b3ceb952c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:21.958977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0ee50-f5b3-4d84-9336-a1ccf0b7a05c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:21.959195 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b9115-3479-4533-9e81-02b3ceb952c0 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:21.959628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b9115-3479-4533-9e81-02b3ceb952c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:21.959784 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0ee50-f5b3-4d84-9336-a1ccf0b7a05c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:21.960239 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b9115-3479-4533-9e81-02b3ceb952c0 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:21.961107 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b9115-3479-4533-9e81-02b3ceb952c0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:21.961667 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:21.962158 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b9115-3479-4533-9e81-02b3ceb952c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:21.964664 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b9115-3479-4533-9e81-02b3ceb952c0 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:21.970409 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 376/732] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jun 6 06:57:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:21.977849 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b9115-3479-4533-9e81-02b3ceb952c0 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-d0e0ee50-f5b3-4d84-9336-a1ccf0b7a05c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:21.980526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:21.981506 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:21.982459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:21.982459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:21.982459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:21.982459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:21.982459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:21.982459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:21.982459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:21.982459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:21.982459 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 357/733] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:21.989026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0ee50-f5b3-4d84-9336-a1ccf0b7a05c None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:22.095926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b9115-3479-4533-9e81-02b3ceb952c0 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:22.115065 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0ee50-f5b3-4d84-9336-a1ccf0b7a05c None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:22.131174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4acb-8670-45a2-9c26-61a268f598eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:22.131541 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4acb-8670-45a2-9c26-61a268f598eb None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:22.131826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4acb-8670-45a2-9c26-61a268f598eb None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:22.132103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4acb-8670-45a2-9c26-61a268f598eb None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:22.132815 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af4acb-8670-45a2-9c26-61a268f598eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:22.133167 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af4acb-8670-45a2-9c26-61a268f598eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:22.135087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af4acb-8670-45a2-9c26-61a268f598eb None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:22.142511 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 377/734] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Jun 6 06:57:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:22.142511 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48118056-3118-453a-a055-1e7b15310659 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:22.142511 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48118056-3118-453a-a055-1e7b15310659 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:22.142511 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48118056-3118-453a-a055-1e7b15310659 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:22.143794 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 378/735] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:22.146029 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48118056-3118-453a-a055-1e7b15310659 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:22.156926 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f678-1a1b-4d84-beac-4b2c8bad53f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:22.157600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f678-1a1b-4d84-beac-4b2c8bad53f5 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:22.157889 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f678-1a1b-4d84-beac-4b2c8bad53f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:22.158174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f678-1a1b-4d84-beac-4b2c8bad53f5 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:22.159007 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f678-1a1b-4d84-beac-4b2c8bad53f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:22.159327 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f678-1a1b-4d84-beac-4b2c8bad53f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:22.160793 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f678-1a1b-4d84-beac-4b2c8bad53f5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:22.173222 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 358/736] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:22.174559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d779-4e8b-4308-bb0d-4a43db09f6ee None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:22.174858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d779-4e8b-4308-bb0d-4a43db09f6ee None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:22.175144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d779-4e8b-4308-bb0d-4a43db09f6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:22.192248 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-8790d779-4e8b-4308-bb0d-4a43db09f6ee None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:22.193444 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-8790d779-4e8b-4308-bb0d-4a43db09f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:22.218147 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:22.251809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:22.264534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48118056-3118-453a-a055-1e7b15310659 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:22.267054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 359/737] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:22 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:22.267885 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d779-4e8b-4308-bb0d-4a43db09f6ee None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:22.315486 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590a6fd-7669-41f7-9d4c-bdec1880fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:22.316148 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a6fd-7669-41f7-9d4c-bdec1880fcdd None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:22.316437 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a6fd-7669-41f7-9d4c-bdec1880fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:22.316710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a6fd-7669-41f7-9d4c-bdec1880fcdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:22.317472 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590a6fd-7669-41f7-9d4c-bdec1880fcdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:22.318872 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590a6fd-7669-41f7-9d4c-bdec1880fcdd None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:22.371025 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d779-4e8b-4308-bb0d-4a43db09f6ee None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:22.394976 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 379/738] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jun 6 06:57:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:57:22.396331 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590a6fd-7669-41f7-9d4c-bdec1880fcdd None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:22.432064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd047ed-938f-4bb1-be4c-fc5169d07c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:22.432907 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd047ed-938f-4bb1-be4c-fc5169d07c09 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:22.433248 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd047ed-938f-4bb1-be4c-fc5169d07c09 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:22.433621 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd047ed-938f-4bb1-be4c-fc5169d07c09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:22.434534 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd047ed-938f-4bb1-be4c-fc5169d07c09 None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=f446e118975f44b4b31511302a7af36e) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:22.434857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd047ed-938f-4bb1-be4c-fc5169d07c09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:22.437284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd047ed-938f-4bb1-be4c-fc5169d07c09 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:22.454357 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 360/739] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:57:22 2022] GET /identity/v3/role_assignments?user.id=f446e118975f44b4b31511302a7af36e&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:22.555982 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590a6fd-7669-41f7-9d4c-bdec1880fcdd None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:22.576635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:22.599748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255655-7458-4496-930e-c0868a4bdbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:22.600893 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255655-7458-4496-930e-c0868a4bdbde None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:22.601340 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255655-7458-4496-930e-c0868a4bdbde None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:22.601772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255655-7458-4496-930e-c0868a4bdbde None admin] PATH_INFO: `/v3/services/network` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:22.603266 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e255655-7458-4496-930e-c0868a4bdbde None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:22.604761 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e255655-7458-4496-930e-c0868a4bdbde None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-5e255655-7458-4496-930e-c0868a4bdbde None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:22.618751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:22.619878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:22.620874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 380/740] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:22 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:22.626872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd047ed-938f-4bb1-be4c-fc5169d07c09 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:22.691944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:22.747514 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd047ed-938f-4bb1-be4c-fc5169d07c09 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:22.783061 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e346e01-87ba-41e0-b8fa-054f7da0afe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:22.783726 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e346e01-87ba-41e0-b8fa-054f7da0afe9 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:22.784010 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e346e01-87ba-41e0-b8fa-054f7da0afe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:22.784285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e346e01-87ba-41e0-b8fa-054f7da0afe9 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:22.784999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e346e01-87ba-41e0-b8fa-054f7da0afe9 None admin] RBAC: Adding query filter params (name=network) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:22.785306 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e346e01-87ba-41e0-b8fa-054f7da0afe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:22.786810 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e346e01-87ba-41e0-b8fa-054f7da0afe9 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:22.792141 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 361/741] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:22.797633 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255655-7458-4496-930e-c0868a4bdbde None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:22.907360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255655-7458-4496-930e-c0868a4bdbde None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:22.946201 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aec50f-4186-4ce4-a129-86d6f99821b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:22.946201 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec50f-4186-4ce4-a129-86d6f99821b9 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:22.946201 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec50f-4186-4ce4-a129-86d6f99821b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:22.946201 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec50f-4186-4ce4-a129-86d6f99821b9 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:22.946637 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec50f-4186-4ce4-a129-86d6f99821b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:22.946637 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec50f-4186-4ce4-a129-86d6f99821b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:22.946981 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec50f-4186-4ce4-a129-86d6f99821b9 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:22.952212 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 381/742] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:22.957525 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e346e01-87ba-41e0-b8fa-054f7da0afe9 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:23.066538 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e346e01-87ba-41e0-b8fa-054f7da0afe9 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:23.080250 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:23.103000 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f7f64-1e97-4fb4-ba7f-119f69b5aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:23.103671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7f64-1e97-4fb4-ba7f-119f69b5aeae None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:23.103961 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7f64-1e97-4fb4-ba7f-119f69b5aeae None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:23.104245 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7f64-1e97-4fb4-ba7f-119f69b5aeae None admin] PATH_INFO: `/v3/endpoints` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:23.105011 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f7f64-1e97-4fb4-ba7f-119f69b5aeae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:23.106404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f7f64-1e97-4fb4-ba7f-119f69b5aeae None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:23.179303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 362/743] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jun 6 06:57:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:57:23.812918 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed317e7-9d6e-47c4-8e15-348bd80f8871 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:23.813442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed317e7-9d6e-47c4-8e15-348bd80f8871 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:23.813546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed317e7-9d6e-47c4-8e15-348bd80f8871 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:23.815000 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 382/744] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:23.819986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b037-c5d5-4697-94fd-c1921b38b8d9 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:23.820384 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b037-c5d5-4697-94fd-c1921b38b8d9 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:23.820560 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b037-c5d5-4697-94fd-c1921b38b8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:23.838861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-db50b037-c5d5-4697-94fd-c1921b38b8d9 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:23.840064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-db50b037-c5d5-4697-94fd-c1921b38b8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:23.922378 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 363/745] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:23 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:23.943334 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed317e7-9d6e-47c4-8e15-348bd80f8871 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:23.993838 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:24.071200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed317e7-9d6e-47c4-8e15-348bd80f8871 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:24.108970 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35760766-49ee-4196-984e-cf9e9f97150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:24.109612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760766-49ee-4196-984e-cf9e9f97150d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:24.109899 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760766-49ee-4196-984e-cf9e9f97150d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:24.110235 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760766-49ee-4196-984e-cf9e9f97150d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:24.181880 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35760766-49ee-4196-984e-cf9e9f97150d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:24.183369 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35760766-49ee-4196-984e-cf9e9f97150d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:24.226870 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:24.286835 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 383/746] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:57:23 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 06:57:24.288504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50b037-c5d5-4697-94fd-c1921b38b8d9 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:24.387939 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:24.395080 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50b037-c5d5-4697-94fd-c1921b38b8d9 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:24.431145 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aaa84-184d-4c86-8464-11b9d1404e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:24.432025 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aaa84-184d-4c86-8464-11b9d1404e0b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:24.432319 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aaa84-184d-4c86-8464-11b9d1404e0b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:24.432603 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aaa84-184d-4c86-8464-11b9d1404e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:24.443369 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aaa84-184d-4c86-8464-11b9d1404e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:24.444829 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aaa84-184d-4c86-8464-11b9d1404e0b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-863aaa84-184d-4c86-8464-11b9d1404e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:57:24.463824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:24.464757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:24.465671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:57:24.465671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:57:24.465671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:57:24.465671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:24.469968 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 364/747] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:24.471350 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35760766-49ee-4196-984e-cf9e9f97150d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:24.581278 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35760766-49ee-4196-984e-cf9e9f97150d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:24.616890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af82bc3-0d9d-4fc8-bbd6-131454458e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:24.618105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af82bc3-0d9d-4fc8-bbd6-131454458e9a None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:24.618422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af82bc3-0d9d-4fc8-bbd6-131454458e9a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:24.618705 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af82bc3-0d9d-4fc8-bbd6-131454458e9a None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:24.619428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af82bc3-0d9d-4fc8-bbd6-131454458e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:24.619738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af82bc3-0d9d-4fc8-bbd6-131454458e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:24.621102 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af82bc3-0d9d-4fc8-bbd6-131454458e9a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:24.638466 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 384/748] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:24.898083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bca6d-ee34-46e8-86ef-cffc683ec157 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:24.899191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bca6d-ee34-46e8-86ef-cffc683ec157 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:24.899632 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bca6d-ee34-46e8-86ef-cffc683ec157 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:24.901412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 365/749] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:24.902113 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c921-3928-4fe0-b93b-8fb6280b6a02 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:24.902568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c921-3928-4fe0-b93b-8fb6280b6a02 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:24.902771 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c921-3928-4fe0-b93b-8fb6280b6a02 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:24.904053 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 385/750] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:57:24.906845 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545a864-180f-473d-be1e-b68121c37f7f None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:24.907140 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545a864-180f-473d-be1e-b68121c37f7f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:24.907423 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545a864-180f-473d-be1e-b68121c37f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:24.909086 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5fcda-0f61-4779-8dbb-396a077c8ead None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:24.909670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5fcda-0f61-4779-8dbb-396a077c8ead None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:24.910240 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5fcda-0f61-4779-8dbb-396a077c8ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:24.918357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:24.926875 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-7545a864-180f-473d-be1e-b68121c37f7f None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:24.928097 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-7545a864-180f-473d-be1e-b68121c37f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:24.932351 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-d8d5fcda-0f61-4779-8dbb-396a077c8ead None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:24.933105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-d8d5fcda-0f61-4779-8dbb-396a077c8ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:25.000890 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 366/751] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:24 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:25.004064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 386/752] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:24 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:57:25.026103 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545a864-180f-473d-be1e-b68121c37f7f None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:25.026905 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5fcda-0f61-4779-8dbb-396a077c8ead None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:25.102281 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:25.124187 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5fcda-0f61-4779-8dbb-396a077c8ead None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:25.124819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545a864-180f-473d-be1e-b68121c37f7f None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:25.158561 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e783c7-2769-4245-8473-0c315841ed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:25.159307 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e783c7-2769-4245-8473-0c315841ed8b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:25.159594 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e783c7-2769-4245-8473-0c315841ed8b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:25.159694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838c826-7408-4044-ba8f-12b1de7bfebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:25.159874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e783c7-2769-4245-8473-0c315841ed8b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:25.160478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838c826-7408-4044-ba8f-12b1de7bfebf None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:25.160571 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e783c7-2769-4245-8473-0c315841ed8b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:25.160768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838c826-7408-4044-ba8f-12b1de7bfebf None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:25.161051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838c826-7408-4044-ba8f-12b1de7bfebf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:25.161713 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838c826-7408-4044-ba8f-12b1de7bfebf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:25.161908 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e783c7-2769-4245-8473-0c315841ed8b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:25.163113 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838c826-7408-4044-ba8f-12b1de7bfebf None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:25.163699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-33e783c7-2769-4245-8473-0c315841ed8b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:25.174494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:25.175456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 06:57:25.176828 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-1838c826-7408-4044-ba8f-12b1de7bfebf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:25.177948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:25.179181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 06:57:25.180735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:25.182267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 387/753] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Jun 6 06:57:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:25.182399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 367/754] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:57:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:25.182488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e783c7-2769-4245-8473-0c315841ed8b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:25.182570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838c826-7408-4044-ba8f-12b1de7bfebf None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:25.281451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e783c7-2769-4245-8473-0c315841ed8b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:25.284511 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838c826-7408-4044-ba8f-12b1de7bfebf None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:25.316027 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd26f-020d-47d0-a407-4c4249174d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:25.316692 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd26f-020d-47d0-a407-4c4249174d28 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:25.316977 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd26f-020d-47d0-a407-4c4249174d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:25.317256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd26f-020d-47d0-a407-4c4249174d28 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:25.317964 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd26f-020d-47d0-a407-4c4249174d28 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:25.318274 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd26f-020d-47d0-a407-4c4249174d28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:25.318768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466ab2d-6ee9-4597-877c-b24b65e72c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:25.319436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466ab2d-6ee9-4597-877c-b24b65e72c41 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:25.319688 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd26f-020d-47d0-a407-4c4249174d28 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:25.319808 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466ab2d-6ee9-4597-877c-b24b65e72c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:25.319997 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466ab2d-6ee9-4597-877c-b24b65e72c41 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:25.320733 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466ab2d-6ee9-4597-877c-b24b65e72c41 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:25.321049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466ab2d-6ee9-4597-877c-b24b65e72c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:25.322463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466ab2d-6ee9-4597-877c-b24b65e72c41 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:25.324283 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 388/755] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jun 6 06:57:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:25.327008 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 368/756] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:57:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:25.329770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd26f-020d-47d0-a407-4c4249174d28 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:25.332509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466ab2d-6ee9-4597-877c-b24b65e72c41 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:25.336454 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:25.397092 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:25.436188 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466ab2d-6ee9-4597-877c-b24b65e72c41 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:25.437040 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd26f-020d-47d0-a407-4c4249174d28 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:25.468702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f281a-9a83-44b2-9c11-d5c3c3c1ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:25.469362 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f281a-9a83-44b2-9c11-d5c3c3c1ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:25.469650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f281a-9a83-44b2-9c11-d5c3c3c1ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:25.469933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f281a-9a83-44b2-9c11-d5c3c3c1ecb9 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:25.470105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0623cb-0249-4a3b-bb43-3f57f5b3f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:25.470680 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f281a-9a83-44b2-9c11-d5c3c3c1ecb9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:25.470801 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0623cb-0249-4a3b-bb43-3f57f5b3f66e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:25.470989 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f281a-9a83-44b2-9c11-d5c3c3c1ecb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:25.471081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0623cb-0249-4a3b-bb43-3f57f5b3f66e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:25.471356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0623cb-0249-4a3b-bb43-3f57f5b3f66e None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:25.472067 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0623cb-0249-4a3b-bb43-3f57f5b3f66e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:25.472355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f281a-9a83-44b2-9c11-d5c3c3c1ecb9 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:25.472451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0623cb-0249-4a3b-bb43-3f57f5b3f66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:25.473736 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0623cb-0249-4a3b-bb43-3f57f5b3f66e None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:25.477421 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 369/757] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:57:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:25.478765 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 389/758] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jun 6 06:57:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:27.792463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb35bc-9fe0-439a-a408-80ff8e716253 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:27.793003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb35bc-9fe0-439a-a408-80ff8e716253 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:27.793094 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb35bc-9fe0-439a-a408-80ff8e716253 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:27.794401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 370/759] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:27.799631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f606a0-8bb7-4f87-a7a6-4ef0b03e1f72 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:27.800038 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f606a0-8bb7-4f87-a7a6-4ef0b03e1f72 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:27.800277 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f606a0-8bb7-4f87-a7a6-4ef0b03e1f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:27.812026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd48d6-02e0-4ac2-b0df-cdfd21ded61f None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:27.812358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd48d6-02e0-4ac2-b0df-cdfd21ded61f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:27.812648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd48d6-02e0-4ac2-b0df-cdfd21ded61f None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:27.814088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 371/760] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:57:27.817710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-97f606a0-8bb7-4f87-a7a6-4ef0b03e1f72 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:27.818932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-97f606a0-8bb7-4f87-a7a6-4ef0b03e1f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:27.819118 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0ba34-c5bf-4bc3-9db2-fa1ffb9eba68 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:27.819416 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0ba34-c5bf-4bc3-9db2-fa1ffb9eba68 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:27.819706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0ba34-c5bf-4bc3-9db2-fa1ffb9eba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:27.835922 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-cfc0ba34-c5bf-4bc3-9db2-fa1ffb9eba68 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:27.837137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-cfc0ba34-c5bf-4bc3-9db2-fa1ffb9eba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:27.889942 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 390/761] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:27 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:27.901619 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:27.906859 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 372/762] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:27 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:57:27.913923 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f606a0-8bb7-4f87-a7a6-4ef0b03e1f72 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:27.931181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0ba34-c5bf-4bc3-9db2-fa1ffb9eba68 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:27.971565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:28.017352 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f606a0-8bb7-4f87-a7a6-4ef0b03e1f72 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:28.035070 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0ba34-c5bf-4bc3-9db2-fa1ffb9eba68 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:28.051162 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356eebca-3ba0-4494-923f-cd7560719300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:28.051761 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eebca-3ba0-4494-923f-cd7560719300 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:28.052045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eebca-3ba0-4494-923f-cd7560719300 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:28.052325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eebca-3ba0-4494-923f-cd7560719300 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:28.053053 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356eebca-3ba0-4494-923f-cd7560719300 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:28.054453 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356eebca-3ba0-4494-923f-cd7560719300 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:28.067998 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1be074-9a40-4006-b603-2162c490bd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:28.068649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1be074-9a40-4006-b603-2162c490bd49 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:28.068932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1be074-9a40-4006-b603-2162c490bd49 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:28.070235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1be074-9a40-4006-b603-2162c490bd49 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:28.070235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1be074-9a40-4006-b603-2162c490bd49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:28.071995 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1be074-9a40-4006-b603-2162c490bd49 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:28.134322 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 391/763] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:57:27 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:57:28.156203 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 373/764] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:57:27 2022] POST /identity/v3/services => generated 269 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:57:30.502080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cada85-ad06-4069-a4b3-595a4d28e2a2 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:30.502749 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cada85-ad06-4069-a4b3-595a4d28e2a2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:30.502749 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cada85-ad06-4069-a4b3-595a4d28e2a2 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:30.504286 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 392/765] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:30.509803 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255a275-2e15-418b-b145-b94fd0899c5d None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:30.509965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d4f13-732e-48e2-8451-079b7422a966 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:30.510419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255a275-2e15-418b-b145-b94fd0899c5d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:30.510525 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d4f13-732e-48e2-8451-079b7422a966 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:30.510617 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255a275-2e15-418b-b145-b94fd0899c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:30.510707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d4f13-732e-48e2-8451-079b7422a966 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:30.511826 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 374/766] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:30.516740 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461c585-8fc9-45fa-b21e-7742245dc427 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:30.517035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461c585-8fc9-45fa-b21e-7742245dc427 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:30.517323 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461c585-8fc9-45fa-b21e-7742245dc427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:30.529227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-6255a275-2e15-418b-b145-b94fd0899c5d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:30.530465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-6255a275-2e15-418b-b145-b94fd0899c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:30.534324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-2461c585-8fc9-45fa-b21e-7742245dc427 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:30.535515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-2461c585-8fc9-45fa-b21e-7742245dc427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:30.588594 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:30.603829 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 393/767] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:30 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:30.609016 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 375/768] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:30 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:57:30.628020 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255a275-2e15-418b-b145-b94fd0899c5d None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:30.632699 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461c585-8fc9-45fa-b21e-7742245dc427 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:30.670730 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:30.727511 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255a275-2e15-418b-b145-b94fd0899c5d None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:30.730818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461c585-8fc9-45fa-b21e-7742245dc427 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:30.761962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956b2c-833f-40e8-b006-45d99a27503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:30.762731 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956b2c-833f-40e8-b006-45d99a27503a None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:30.763021 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956b2c-833f-40e8-b006-45d99a27503a None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:30.763302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956b2c-833f-40e8-b006-45d99a27503a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:30.763962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956b2c-833f-40e8-b006-45d99a27503a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:30.764644 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980370c-03a7-42a8-a3b7-4b2273ca9453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:30.765337 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956b2c-833f-40e8-b006-45d99a27503a None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:30.765437 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980370c-03a7-42a8-a3b7-4b2273ca9453 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:30.765707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980370c-03a7-42a8-a3b7-4b2273ca9453 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:30.765987 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980370c-03a7-42a8-a3b7-4b2273ca9453 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:30.766674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980370c-03a7-42a8-a3b7-4b2273ca9453 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:30.768037 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980370c-03a7-42a8-a3b7-4b2273ca9453 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-9a956b2c-833f-40e8-b006-45d99a27503a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:30.777926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:30.779182 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:30.780101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 394/769] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Jun 6 06:57:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-8980370c-03a7-42a8-a3b7-4b2273ca9453 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:30.781022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:30.781941 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:30.783654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 376/770] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:57:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:30.785177 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956b2c-833f-40e8-b006-45d99a27503a None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:30.786986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980370c-03a7-42a8-a3b7-4b2273ca9453 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:30.836975 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:30.886269 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956b2c-833f-40e8-b006-45d99a27503a None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:30.888442 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980370c-03a7-42a8-a3b7-4b2273ca9453 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:30.893172 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:30.920364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41537327-0440-466e-8abb-43d22f734c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:30.921044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41537327-0440-466e-8abb-43d22f734c06 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:30.921329 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41537327-0440-466e-8abb-43d22f734c06 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:30.921603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41537327-0440-466e-8abb-43d22f734c06 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:30.922314 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41537327-0440-466e-8abb-43d22f734c06 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:30.922652 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41537327-0440-466e-8abb-43d22f734c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:30.924148 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41537327-0440-466e-8abb-43d22f734c06 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:30.929078 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 395/771] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jun 6 06:57:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:30.929238 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fd547-7282-4a64-923e-0cc49b1145cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:30.929847 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fd547-7282-4a64-923e-0cc49b1145cd None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:30.930676 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fd547-7282-4a64-923e-0cc49b1145cd None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:30.930963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fd547-7282-4a64-923e-0cc49b1145cd None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:30.931673 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fd547-7282-4a64-923e-0cc49b1145cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:30.931980 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fd547-7282-4a64-923e-0cc49b1145cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:30.933340 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fd547-7282-4a64-923e-0cc49b1145cd None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:30.935407 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41537327-0440-466e-8abb-43d22f734c06 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:30.938440 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 377/772] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:57:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:30.943722 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fd547-7282-4a64-923e-0cc49b1145cd None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:31.033802 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41537327-0440-466e-8abb-43d22f734c06 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:31.043205 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fd547-7282-4a64-923e-0cc49b1145cd None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:31.056020 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:31.067344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420d6f-1052-4f85-8191-52354911da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:31.068004 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420d6f-1052-4f85-8191-52354911da82 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:31.070178 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420d6f-1052-4f85-8191-52354911da82 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:31.070178 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420d6f-1052-4f85-8191-52354911da82 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:31.070178 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420d6f-1052-4f85-8191-52354911da82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:31.070178 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420d6f-1052-4f85-8191-52354911da82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:31.071504 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420d6f-1052-4f85-8191-52354911da82 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:31.076312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 396/773] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jun 6 06:57:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:31.078690 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b95dd7-849d-4600-8344-3e6fd18be820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:31.079349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95dd7-849d-4600-8344-3e6fd18be820 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:31.079640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95dd7-849d-4600-8344-3e6fd18be820 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:31.079920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95dd7-849d-4600-8344-3e6fd18be820 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:31.080629 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b95dd7-849d-4600-8344-3e6fd18be820 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:31.080940 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b95dd7-849d-4600-8344-3e6fd18be820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:31.082233 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420d6f-1052-4f85-8191-52354911da82 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:31.082482 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b95dd7-849d-4600-8344-3e6fd18be820 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:31.092290 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 378/774] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:57:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:31.093247 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b95dd7-849d-4600-8344-3e6fd18be820 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:31.117335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:31.183266 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420d6f-1052-4f85-8191-52354911da82 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:31.190688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b95dd7-849d-4600-8344-3e6fd18be820 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:31.216696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b9eb9-86b8-473b-80ab-92d204521760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:31.217352 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b9eb9-86b8-473b-80ab-92d204521760 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:31.217637 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b9eb9-86b8-473b-80ab-92d204521760 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:31.217915 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b9eb9-86b8-473b-80ab-92d204521760 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:31.218744 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b9eb9-86b8-473b-80ab-92d204521760 None admin] RBAC: Adding query filter params (interface=public, service_id=cbd3eec6f1e44a7f8bb1e2fbdd27502e, region_id=RegionOne) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:31.219055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b9eb9-86b8-473b-80ab-92d204521760 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:31.220433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b9eb9-86b8-473b-80ab-92d204521760 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:31.224149 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7394-a90f-4046-973c-f931977c53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:31.224808 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7394-a90f-4046-973c-f931977c53ce None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:31.225099 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7394-a90f-4046-973c-f931977c53ce None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:31.225381 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7394-a90f-4046-973c-f931977c53ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:31.225831 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 397/775] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jun 6 06:57:31 2022] GET /identity/v3/endpoints?service_id=cbd3eec6f1e44a7f8bb1e2fbdd27502e&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:31.226247 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a7394-a90f-4046-973c-f931977c53ce None admin] RBAC: Adding query filter params (interface=public, service_id=feb9113d47544d208ef1e3509086be0d, region_id=RegionOne) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:31.226668 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a7394-a90f-4046-973c-f931977c53ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:31.228060 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a7394-a90f-4046-973c-f931977c53ce None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:31.230955 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b9eb9-86b8-473b-80ab-92d204521760 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:31.237579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 379/776] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jun 6 06:57:31 2022] GET /identity/v3/endpoints?service_id=feb9113d47544d208ef1e3509086be0d&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:31.238392 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7394-a90f-4046-973c-f931977c53ce None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:31.279472 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:31.326641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:31.330134 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b9eb9-86b8-473b-80ab-92d204521760 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:31.336070 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7394-a90f-4046-973c-f931977c53ce None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:31.363909 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4092e8-a90a-4b10-b58e-b64ea1e4f9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:31.364623 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4092e8-a90a-4b10-b58e-b64ea1e4f9b5 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:31.364911 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4092e8-a90a-4b10-b58e-b64ea1e4f9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:31.365196 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4092e8-a90a-4b10-b58e-b64ea1e4f9b5 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:31.365882 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4092e8-a90a-4b10-b58e-b64ea1e4f9b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:31.367324 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4092e8-a90a-4b10-b58e-b64ea1e4f9b5 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:31.370859 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fec343-1687-48f6-9cd4-264a53b337b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:31.371517 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fec343-1687-48f6-9cd4-264a53b337b5 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:31.371801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fec343-1687-48f6-9cd4-264a53b337b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:31.372078 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fec343-1687-48f6-9cd4-264a53b337b5 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:31.372756 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fec343-1687-48f6-9cd4-264a53b337b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:31.373687 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 398/777] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jun 6 06:57:31 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 06:57:31.374098 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fec343-1687-48f6-9cd4-264a53b337b5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:31.380597 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 380/778] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jun 6 06:57:31 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 06:57:33.706012 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe5b6-e754-4de4-b20f-d7ce5cf6143d None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:33.706583 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe5b6-e754-4de4-b20f-d7ce5cf6143d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:33.706663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe5b6-e754-4de4-b20f-d7ce5cf6143d None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:33.708249 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 399/779] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:33.713246 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e10d2-f517-4750-ac02-3262be278240 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:33.713682 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e10d2-f517-4750-ac02-3262be278240 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:33.713822 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e10d2-f517-4750-ac02-3262be278240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:33.716055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff52cea-1855-4862-8bfe-355fbbb3cae4 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:33.716347 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff52cea-1855-4862-8bfe-355fbbb3cae4 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:33.716628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff52cea-1855-4862-8bfe-355fbbb3cae4 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:33.717859 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 400/780] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:57:33.722852 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16b14b-f67e-4446-8a1f-db60daad1ee5 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:33.723142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16b14b-f67e-4446-8a1f-db60daad1ee5 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:33.723424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16b14b-f67e-4446-8a1f-db60daad1ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:33.731273 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-724e10d2-f517-4750-ac02-3262be278240 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:33.732491 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-724e10d2-f517-4750-ac02-3262be278240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:33.740055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-dd16b14b-f67e-4446-8a1f-db60daad1ee5 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:33.741210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-dd16b14b-f67e-4446-8a1f-db60daad1ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:33.798529 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 381/781] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:33 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:33.810098 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 401/782] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:33 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:57:33.823146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e10d2-f517-4750-ac02-3262be278240 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:33.834239 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16b14b-f67e-4446-8a1f-db60daad1ee5 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:33.855419 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:33.920086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e10d2-f517-4750-ac02-3262be278240 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:33.926462 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:33.935373 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16b14b-f67e-4446-8a1f-db60daad1ee5 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:33.960132 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608c900-3957-4f2e-a03a-8de14b210ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:33.961101 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c900-3957-4f2e-a03a-8de14b210ff9 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:33.961722 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c900-3957-4f2e-a03a-8de14b210ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:33.962146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c900-3957-4f2e-a03a-8de14b210ff9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:33.963239 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608c900-3957-4f2e-a03a-8de14b210ff9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:33.964636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608c900-3957-4f2e-a03a-8de14b210ff9 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:33.969472 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f687-26c7-4e05-9e78-58bbf9e84541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:33.970276 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f687-26c7-4e05-9e78-58bbf9e84541 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:33.970589 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f687-26c7-4e05-9e78-58bbf9e84541 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:33.970866 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f687-26c7-4e05-9e78-58bbf9e84541 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:33.971540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f687-26c7-4e05-9e78-58bbf9e84541 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:33.972918 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f687-26c7-4e05-9e78-58bbf9e84541 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-8608c900-3957-4f2e-a03a-8de14b210ff9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:33.976436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:33.977426 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:33.978487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 382/783] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:57:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:33.983508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608c900-3957-4f2e-a03a-8de14b210ff9 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-8c68f687-26c7-4e05-9e78-58bbf9e84541 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:33.985127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:33.986514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:33.987732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 402/784] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Jun 6 06:57:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:33.992228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f687-26c7-4e05-9e78-58bbf9e84541 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:34.086915 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:34.091072 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608c900-3957-4f2e-a03a-8de14b210ff9 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:34.092074 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f687-26c7-4e05-9e78-58bbf9e84541 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:34.124682 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb59d2-22b7-49a8-aab0-e71f538f6a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:34.125409 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb59d2-22b7-49a8-aab0-e71f538f6a98 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:34.125589 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cd559-5727-4cbd-b4cd-6c06245e75fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:34.125703 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb59d2-22b7-49a8-aab0-e71f538f6a98 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:34.125956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb59d2-22b7-49a8-aab0-e71f538f6a98 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:34.126248 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cd559-5727-4cbd-b4cd-6c06245e75fe None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:34.126567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cd559-5727-4cbd-b4cd-6c06245e75fe None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:34.126690 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb59d2-22b7-49a8-aab0-e71f538f6a98 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:34.126849 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cd559-5727-4cbd-b4cd-6c06245e75fe None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:34.126996 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb59d2-22b7-49a8-aab0-e71f538f6a98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:34.127559 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cd559-5727-4cbd-b4cd-6c06245e75fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:34.127874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cd559-5727-4cbd-b4cd-6c06245e75fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:34.128620 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb59d2-22b7-49a8-aab0-e71f538f6a98 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:34.129498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cd559-5727-4cbd-b4cd-6c06245e75fe None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:34.133999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 383/785] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:57:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:34.138610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 403/786] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jun 6 06:57:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:34.139911 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb59d2-22b7-49a8-aab0-e71f538f6a98 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:34.140042 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cd559-5727-4cbd-b4cd-6c06245e75fe None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:34.162199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:34.238968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cd559-5727-4cbd-b4cd-6c06245e75fe None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:34.242066 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb59d2-22b7-49a8-aab0-e71f538f6a98 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:34.273656 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fbc8a-1bea-421a-9eb3-103e24432479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:34.274322 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fbc8a-1bea-421a-9eb3-103e24432479 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:34.274637 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fbc8a-1bea-421a-9eb3-103e24432479 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:34.274921 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fbc8a-1bea-421a-9eb3-103e24432479 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:34.275633 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fbc8a-1bea-421a-9eb3-103e24432479 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:34.275947 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fbc8a-1bea-421a-9eb3-103e24432479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:34.277320 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fbc8a-1bea-421a-9eb3-103e24432479 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:34.277622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06babf9-2477-4a77-a2d6-7fc6ddab18b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:34.278284 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06babf9-2477-4a77-a2d6-7fc6ddab18b4 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:34.278609 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06babf9-2477-4a77-a2d6-7fc6ddab18b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:34.278892 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06babf9-2477-4a77-a2d6-7fc6ddab18b4 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:34.279668 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06babf9-2477-4a77-a2d6-7fc6ddab18b4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:34.279980 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06babf9-2477-4a77-a2d6-7fc6ddab18b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:34.281366 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06babf9-2477-4a77-a2d6-7fc6ddab18b4 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:34.282362 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 404/787] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Jun 6 06:57:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:34.286569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 384/788] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Jun 6 06:57:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:34.290434 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fbc8a-1bea-421a-9eb3-103e24432479 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:34.292322 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06babf9-2477-4a77-a2d6-7fc6ddab18b4 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:34.319589 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:34.372863 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:34.389014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fbc8a-1bea-421a-9eb3-103e24432479 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:34.393672 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06babf9-2477-4a77-a2d6-7fc6ddab18b4 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:34.424278 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7d8e2-4c92-4430-b09e-318ed74758db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:34.424943 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7d8e2-4c92-4430-b09e-318ed74758db None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:34.425233 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7d8e2-4c92-4430-b09e-318ed74758db None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:34.425520 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7d8e2-4c92-4430-b09e-318ed74758db None admin] PATH_INFO: `/v3/endpoints` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:34.426278 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7d8e2-4c92-4430-b09e-318ed74758db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:34.427521 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5826d-48e7-4216-a4eb-1b7edb886ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:34.427680 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7d8e2-4c92-4430-b09e-318ed74758db None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:34.428175 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5826d-48e7-4216-a4eb-1b7edb886ba4 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:34.428465 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5826d-48e7-4216-a4eb-1b7edb886ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:34.428748 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5826d-48e7-4216-a4eb-1b7edb886ba4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:34.429484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5826d-48e7-4216-a4eb-1b7edb886ba4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:34.430883 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5826d-48e7-4216-a4eb-1b7edb886ba4 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:34.510053 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 405/789] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jun 6 06:57:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:57:34.533645 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 385/790] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jun 6 06:57:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:57:36.844265 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c630b2c-b0e9-4221-b1fc-e5a025843b50 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:36.844822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c630b2c-b0e9-4221-b1fc-e5a025843b50 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:36.844822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c630b2c-b0e9-4221-b1fc-e5a025843b50 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:36.846301 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 406/791] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:36.851431 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0633f6b-2c3d-45cd-ae42-6c108c92fafe None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:36.851906 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0633f6b-2c3d-45cd-ae42-6c108c92fafe None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:36.851994 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0633f6b-2c3d-45cd-ae42-6c108c92fafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:36.860859 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576daad3-38e9-429e-9381-28ef2137a13a None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:36.861142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576daad3-38e9-429e-9381-28ef2137a13a None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:36.861419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576daad3-38e9-429e-9381-28ef2137a13a None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:36.862745 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 407/792] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:57:36.868161 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae9870-a7a6-4311-b33b-82688fc861cc None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:36.868464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae9870-a7a6-4311-b33b-82688fc861cc None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:36.868741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae9870-a7a6-4311-b33b-82688fc861cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:36.869435 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-a0633f6b-2c3d-45cd-ae42-6c108c92fafe None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:36.870683 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-a0633f6b-2c3d-45cd-ae42-6c108c92fafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:36.885427 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-26ae9870-a7a6-4311-b33b-82688fc861cc None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:36.886603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-26ae9870-a7a6-4311-b33b-82688fc861cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:36.947547 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 386/793] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:36 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:36.957853 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 408/794] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:36 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:57:36.970422 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0633f6b-2c3d-45cd-ae42-6c108c92fafe None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:36.980379 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:36.982139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae9870-a7a6-4311-b33b-82688fc861cc None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:37.051415 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:37.069752 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0633f6b-2c3d-45cd-ae42-6c108c92fafe None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:37.082305 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae9870-a7a6-4311-b33b-82688fc861cc None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:37.104403 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707f51f-eb83-414e-adb6-aba3b7b3e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:37.105126 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707f51f-eb83-414e-adb6-aba3b7b3e09d None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:37.105408 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707f51f-eb83-414e-adb6-aba3b7b3e09d None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:37.105720 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707f51f-eb83-414e-adb6-aba3b7b3e09d None admin] PATH_INFO: `/v3/services/compute` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:37.106395 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707f51f-eb83-414e-adb6-aba3b7b3e09d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:37.107769 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707f51f-eb83-414e-adb6-aba3b7b3e09d None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:37.118097 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:37.118798 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:37.119084 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:37.119361 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:37.120063 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:37.121491 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-5707f51f-eb83-414e-adb6-aba3b7b3e09d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:37.121591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:37.127399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 06:57:37.128707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:37.129474 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING keystone.server.flask.common [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 06 06:57:37.129559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 387/795] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:37.130099 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707f51f-eb83-414e-adb6-aba3b7b3e09d None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:37.165455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.sql.core [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 06 06:57:37.165455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 06 06:57:37.165455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [parameters: {'id': '5ebef8f21c3e454bb583bfe8ff2b02df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 06 06:57:37.165455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87366) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ebef8f21c3e454bb583bfe8ff2b02df.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ebef8f21c3e454bb583bfe8ff2b02df. Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application conn.query(q) Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 06:57:37.182051 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application result.read() Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 06 06:57:37.192959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application next(self.gen) Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application yield resource Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application next(self.gen) Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self.session.rollback() Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self.force_reraise() Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise self.value Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application session.commit() Jun 06 06:57:37.194022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._prepare_impl() Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self.session.flush() Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._flush(objects) Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application compat.raise_( Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application flush_context.execute() Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 06 06:57:37.194993 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rec.execute(self) Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 06 06:57:37.196552 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application conn.query(q) Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application result.read() Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 06:57:37.197383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [parameters: {'id': '5ebef8f21c3e454bb583bfe8ff2b02df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:37.198321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:37.199244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ebef8f21c3e454bb583bfe8ff2b02df. Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 409/796] 10.222.0.42 () {60 vars in 1140 bytes} [Mon Jun 6 06:57:36 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:37.200190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:37.200803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:37.232716 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707f51f-eb83-414e-adb6-aba3b7b3e09d None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:37.266291 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d87da8-83cf-4e45-8964-8c1838557d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:37.266975 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d87da8-83cf-4e45-8964-8c1838557d68 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:37.267263 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d87da8-83cf-4e45-8964-8c1838557d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:37.267545 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d87da8-83cf-4e45-8964-8c1838557d68 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:37.268255 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d87da8-83cf-4e45-8964-8c1838557d68 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:37.268571 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d87da8-83cf-4e45-8964-8c1838557d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:37.269943 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d87da8-83cf-4e45-8964-8c1838557d68 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:37.274700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 388/797] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:37.280266 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d87da8-83cf-4e45-8964-8c1838557d68 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:37.300526 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef8795-da27-4409-8166-0e120d8e94fc None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:37.326646 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:37.335567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ecc7a-264d-4b7b-829f-fbfa90d4e44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:37.336348 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ecc7a-264d-4b7b-829f-fbfa90d4e44d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:37.336626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ecc7a-264d-4b7b-829f-fbfa90d4e44d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:37.336903 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ecc7a-264d-4b7b-829f-fbfa90d4e44d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:37.343438 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ecc7a-264d-4b7b-829f-fbfa90d4e44d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:37.345061 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ecc7a-264d-4b7b-829f-fbfa90d4e44d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-d53ecc7a-264d-4b7b-829f-fbfa90d4e44d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:57:37.359616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:37.360624 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:37.361728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:57:37.361728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:57:37.361728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:57:37.361728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:57:37.361728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:57:37.361728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:57:37.361728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:57:37.361728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:37.361728 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 410/798] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:37.366737 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ecc7a-264d-4b7b-829f-fbfa90d4e44d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:37.382083 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d87da8-83cf-4e45-8964-8c1838557d68 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:37.416001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76130b6-88f2-4de7-8d66-4284a7ab5099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:37.416697 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76130b6-88f2-4de7-8d66-4284a7ab5099 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:37.417031 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76130b6-88f2-4de7-8d66-4284a7ab5099 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:37.417442 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76130b6-88f2-4de7-8d66-4284a7ab5099 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:37.418153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76130b6-88f2-4de7-8d66-4284a7ab5099 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:37.418503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76130b6-88f2-4de7-8d66-4284a7ab5099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:37.419870 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76130b6-88f2-4de7-8d66-4284a7ab5099 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:37.421899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:37.424726 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 389/799] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:37.475230 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ecc7a-264d-4b7b-829f-fbfa90d4e44d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:37.513153 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcb87e-445b-4819-8b51-5dccc4230acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:37.513920 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcb87e-445b-4819-8b51-5dccc4230acf None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:37.514199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcb87e-445b-4819-8b51-5dccc4230acf None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:37.514719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcb87e-445b-4819-8b51-5dccc4230acf None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:37.515707 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcb87e-445b-4819-8b51-5dccc4230acf None admin] RBAC: Adding query filter params (name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:37.516015 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcb87e-445b-4819-8b51-5dccc4230acf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:37.517470 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcb87e-445b-4819-8b51-5dccc4230acf None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:37.539169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 411/800] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:57:39.777600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f069e9-3174-4f2e-820e-6a8ee8c4cc2a None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:39.778151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f069e9-3174-4f2e-820e-6a8ee8c4cc2a None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:39.778151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f069e9-3174-4f2e-820e-6a8ee8c4cc2a None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:39.779558 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 390/801] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:39.785028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3be27-9113-4d40-b2a2-efe1442eb87b None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:39.785429 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3be27-9113-4d40-b2a2-efe1442eb87b None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:39.785594 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3be27-9113-4d40-b2a2-efe1442eb87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:39.802917 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-73f3be27-9113-4d40-b2a2-efe1442eb87b None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:39.804399 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-73f3be27-9113-4d40-b2a2-efe1442eb87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:39.845283 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:39.874948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 412/802] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:39 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:39.895515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98ecf6-fefd-4013-8ce2-64a7b4f628f9 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:39.895811 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98ecf6-fefd-4013-8ce2-64a7b4f628f9 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:39.896100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98ecf6-fefd-4013-8ce2-64a7b4f628f9 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:39.897443 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 391/803] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:39.899353 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3be27-9113-4d40-b2a2-efe1442eb87b None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:39.902949 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762659f3-f4d7-46fa-afc3-61f95f08b99b None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:39.903247 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762659f3-f4d7-46fa-afc3-61f95f08b99b None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:39.903564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762659f3-f4d7-46fa-afc3-61f95f08b99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:39.921148 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-762659f3-f4d7-46fa-afc3-61f95f08b99b None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:39.922391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-762659f3-f4d7-46fa-afc3-61f95f08b99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:39.989554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 392/804] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:39 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:57:40.002352 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3be27-9113-4d40-b2a2-efe1442eb87b None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:40.015647 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762659f3-f4d7-46fa-afc3-61f95f08b99b None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:40.036563 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535f8de-1250-4bed-945a-9b217d924800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:40.037158 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f8de-1250-4bed-945a-9b217d924800 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:40.037448 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f8de-1250-4bed-945a-9b217d924800 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:40.037734 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f8de-1250-4bed-945a-9b217d924800 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:40.038507 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535f8de-1250-4bed-945a-9b217d924800 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:40.040516 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535f8de-1250-4bed-945a-9b217d924800 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:40.104607 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 413/805] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:57:39 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:57:40.115214 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762659f3-f4d7-46fa-afc3-61f95f08b99b None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:40.147024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:40.159575 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:40.160262 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:40.160551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:40.160825 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:40.161598 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:40.163108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:40.165163 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WARNING keystone.server.flask.common [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 06 06:57:40.195062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.sql.core [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 06 06:57:40.195062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 06 06:57:40.195062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [parameters: {'user_id': '8c292f45cd7f444094a715c6543150f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 06 06:57:40.195062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87365) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application conn.query(q) Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application result.read() Jun 06 06:57:40.212499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 06:57:40.213640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application next(self.gen) Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application yield resource Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application next(self.gen) Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self.session.rollback() Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self.force_reraise() Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise self.value Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application session.commit() Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 06 06:57:40.214768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._prepare_impl() Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self.session.flush() Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._flush(objects) Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application compat.raise_( Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application flush_context.execute() Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rec.execute(self) Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 06 06:57:40.215848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 06 06:57:40.216932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application result = self._query(query) Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application conn.query(q) Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application result.read() Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 06 06:57:40.217962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [parameters: {'user_id': '8c292f45cd7f444094a715c6543150f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:40.218993 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 06 06:57:40.219965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 06 06:57:40.221087 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 06 06:57:40.221087 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 06 06:57:40.221087 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 06 06:57:40.221087 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 06 06:57:40.221087 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 06 06:57:40.221087 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:40.221087 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 393/806] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Jun 6 06:57:40 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:57:40.222946 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535f8de-1250-4bed-945a-9b217d924800 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:40.261490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:40.327918 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535f8de-1250-4bed-945a-9b217d924800 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:40.361246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11009d9-4a37-4229-8183-1f2a72a562a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:40.362042 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11009d9-4a37-4229-8183-1f2a72a562a9 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:40.362349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11009d9-4a37-4229-8183-1f2a72a562a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:40.362698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11009d9-4a37-4229-8183-1f2a72a562a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:40.369585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11009d9-4a37-4229-8183-1f2a72a562a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:40.371043 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11009d9-4a37-4229-8183-1f2a72a562a9 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-b11009d9-4a37-4229-8183-1f2a72a562a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:57:40.386811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:40.391635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:40.393099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 414/807] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:57:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:40.394271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:40.494932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a689d79-7b69-47e6-98df-e9ce39a43976 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:40.528896 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138cbb4-5273-4613-ae18-219daf57f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:40.529566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138cbb4-5273-4613-ae18-219daf57f87a None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:40.529858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138cbb4-5273-4613-ae18-219daf57f87a None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:40.530139 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138cbb4-5273-4613-ae18-219daf57f87a None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:40.530985 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138cbb4-5273-4613-ae18-219daf57f87a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:40.531296 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138cbb4-5273-4613-ae18-219daf57f87a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:40.532923 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138cbb4-5273-4613-ae18-219daf57f87a None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:40.569723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 394/808] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Jun 6 06:57:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:42.404541 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9528d-79e3-4f8f-ba01-a93160485b65 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:42.405058 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9528d-79e3-4f8f-ba01-a93160485b65 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:42.405145 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9528d-79e3-4f8f-ba01-a93160485b65 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:42.406512 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 415/809] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:42.411705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c7d1-0cbc-4f28-a091-d4db7eb31cf7 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:42.412136 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c7d1-0cbc-4f28-a091-d4db7eb31cf7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:42.412270 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c7d1-0cbc-4f28-a091-d4db7eb31cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:42.429832 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-e737c7d1-0cbc-4f28-a091-d4db7eb31cf7 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:42.431455 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-e737c7d1-0cbc-4f28-a091-d4db7eb31cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:42.473764 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:42.497680 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 395/810] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:42 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:57:42.522775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9528d-79e3-4f8f-ba01-a93160485b65 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:42.614388 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:42.620748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9528d-79e3-4f8f-ba01-a93160485b65 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:42.654499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818d391-008e-47bc-9c60-3a35c164d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:42.655321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818d391-008e-47bc-9c60-3a35c164d909 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:42.655555 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818d391-008e-47bc-9c60-3a35c164d909 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:42.655832 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818d391-008e-47bc-9c60-3a35c164d909 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:42.656478 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818d391-008e-47bc-9c60-3a35c164d909 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:42.657853 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818d391-008e-47bc-9c60-3a35c164d909 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-4818d391-008e-47bc-9c60-3a35c164d909 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:42.669160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:42.670294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:57:42.671386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 416/811] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:42.676315 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737c7d1-0cbc-4f28-a091-d4db7eb31cf7 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:42.771406 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737c7d1-0cbc-4f28-a091-d4db7eb31cf7 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:42.803836 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b45d4-1735-4e56-b156-878f67c7fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:42.804487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b45d4-1735-4e56-b156-878f67c7fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:42.804772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b45d4-1735-4e56-b156-878f67c7fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:42.805080 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b45d4-1735-4e56-b156-878f67c7fcf0 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:42.805786 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b45d4-1735-4e56-b156-878f67c7fcf0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:42.806096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b45d4-1735-4e56-b156-878f67c7fcf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:42.807499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b45d4-1735-4e56-b156-878f67c7fcf0 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:42.812220 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 396/812] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:42.817780 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818d391-008e-47bc-9c60-3a35c164d909 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:42.916899 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818d391-008e-47bc-9c60-3a35c164d909 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:42.949495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c9dbb-e7e8-4382-939f-ec6960a9e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:42.950146 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9dbb-e7e8-4382-939f-ec6960a9e857 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:42.950465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9dbb-e7e8-4382-939f-ec6960a9e857 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:42.950748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9dbb-e7e8-4382-939f-ec6960a9e857 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:42.951450 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c9dbb-e7e8-4382-939f-ec6960a9e857 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:42.951760 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c9dbb-e7e8-4382-939f-ec6960a9e857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:42.953132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c9dbb-e7e8-4382-939f-ec6960a9e857 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:42.957918 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 417/813] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:42.963704 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b45d4-1735-4e56-b156-878f67c7fcf0 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:43.004850 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:43.060592 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b45d4-1735-4e56-b156-878f67c7fcf0 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:43.093710 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e662d-7be8-4a6d-ae67-b6598382a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:43.094394 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e662d-7be8-4a6d-ae67-b6598382a801 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:43.094687 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e662d-7be8-4a6d-ae67-b6598382a801 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:43.094970 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e662d-7be8-4a6d-ae67-b6598382a801 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:43.095787 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e662d-7be8-4a6d-ae67-b6598382a801 None admin] RBAC: Adding query filter params (interface=public, service_id=1e67865375a4421fbda39932e9bba4ec, region_id=RegionOne) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:43.096106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e662d-7be8-4a6d-ae67-b6598382a801 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:43.097475 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e662d-7be8-4a6d-ae67-b6598382a801 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:43.102520 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 397/814] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jun 6 06:57:42 2022] GET /identity/v3/endpoints?service_id=1e67865375a4421fbda39932e9bba4ec&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:43.108238 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c9dbb-e7e8-4382-939f-ec6960a9e857 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:43.134974 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:43.207593 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c9dbb-e7e8-4382-939f-ec6960a9e857 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:43.245354 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aebe8c-33c3-4078-81ec-81fd3bdf9203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:43.246016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aebe8c-33c3-4078-81ec-81fd3bdf9203 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:43.246308 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aebe8c-33c3-4078-81ec-81fd3bdf9203 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:43.246627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aebe8c-33c3-4078-81ec-81fd3bdf9203 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:43.247315 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aebe8c-33c3-4078-81ec-81fd3bdf9203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:43.248705 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aebe8c-33c3-4078-81ec-81fd3bdf9203 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:43.255250 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 418/815] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jun 6 06:57:43 2022] GET /identity/v3/services => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 06:57:45.584383 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9700e-aff9-4eb6-a046-6495da3e298c None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:45.584920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9700e-aff9-4eb6-a046-6495da3e298c None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:45.585250 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9700e-aff9-4eb6-a046-6495da3e298c None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:45.586679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 398/816] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:57:45.592031 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369710eb-c4aa-46c9-bfd9-a5781e0ccabb None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:45.592425 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369710eb-c4aa-46c9-bfd9-a5781e0ccabb None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:45.592597 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369710eb-c4aa-46c9-bfd9-a5781e0ccabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:45.609525 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-369710eb-c4aa-46c9-bfd9-a5781e0ccabb None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:57:45.610790 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-369710eb-c4aa-46c9-bfd9-a5781e0ccabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:57:45.675202 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 419/817] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:57:45 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:57:45.699269 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9700e-aff9-4eb6-a046-6495da3e298c None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:45.796217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9700e-aff9-4eb6-a046-6495da3e298c None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:45.798499 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:45.829628 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65c7c-9138-47ad-a5c4-83a4074d683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:45.830420 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65c7c-9138-47ad-a5c4-83a4074d683a None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:45.830708 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65c7c-9138-47ad-a5c4-83a4074d683a None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:45.830989 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65c7c-9138-47ad-a5c4-83a4074d683a None admin] PATH_INFO: `/v3/services/compute` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:45.831634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65c7c-9138-47ad-a5c4-83a4074d683a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:45.832984 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65c7c-9138-47ad-a5c4-83a4074d683a None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-7bd65c7c-9138-47ad-a5c4-83a4074d683a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:57:45.844768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:57:45.845897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:57:45.846776 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 399/818] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:57:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:57:45.852395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369710eb-c4aa-46c9-bfd9-a5781e0ccabb None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:45.870742 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:45.949714 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369710eb-c4aa-46c9-bfd9-a5781e0ccabb None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:45.982959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77961c-aaae-4826-a171-c552cf7b4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:45.983606 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77961c-aaae-4826-a171-c552cf7b4583 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:45.983887 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77961c-aaae-4826-a171-c552cf7b4583 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:45.984161 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77961c-aaae-4826-a171-c552cf7b4583 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:45.984860 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77961c-aaae-4826-a171-c552cf7b4583 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:45.985163 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77961c-aaae-4826-a171-c552cf7b4583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:45.986556 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77961c-aaae-4826-a171-c552cf7b4583 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:45.991155 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 420/819] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:45.998607 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65c7c-9138-47ad-a5c4-83a4074d683a None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:46.097827 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65c7c-9138-47ad-a5c4-83a4074d683a None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:46.130475 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755a4c4-e9c7-4a0b-ad20-f0c9ab0c1393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:46.131129 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755a4c4-e9c7-4a0b-ad20-f0c9ab0c1393 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:46.131418 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755a4c4-e9c7-4a0b-ad20-f0c9ab0c1393 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:46.131698 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755a4c4-e9c7-4a0b-ad20-f0c9ab0c1393 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:46.132400 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755a4c4-e9c7-4a0b-ad20-f0c9ab0c1393 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:57:46.132710 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755a4c4-e9c7-4a0b-ad20-f0c9ab0c1393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:46.134118 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755a4c4-e9c7-4a0b-ad20-f0c9ab0c1393 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:46.138840 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 400/820] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Jun 6 06:57:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:57:46.144493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77961c-aaae-4826-a171-c552cf7b4583 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:57:46.224456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:46.242193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77961c-aaae-4826-a171-c552cf7b4583 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:57:46.276166 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c71ddd-3d7e-4a57-aa0c-381b4efe2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:57:46.276814 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c71ddd-3d7e-4a57-aa0c-381b4efe2701 None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:57:46.277101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c71ddd-3d7e-4a57-aa0c-381b4efe2701 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:57:46.277383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c71ddd-3d7e-4a57-aa0c-381b4efe2701 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:57:46.278124 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c71ddd-3d7e-4a57-aa0c-381b4efe2701 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:57:46.279524 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c71ddd-3d7e-4a57-aa0c-381b4efe2701 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:57:46.338255 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 421/821] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jun 6 06:57:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 06:57:56.136396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=84 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:57:56.333572 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:04.664174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22951e98-8f48-4c98-aff1-b7fef83cd507 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:04.664782 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22951e98-8f48-4c98-aff1-b7fef83cd507 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:04.664782 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22951e98-8f48-4c98-aff1-b7fef83cd507 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:04.665925 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 401/822] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 06:59:04.672259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570f7a2-40be-4fc5-a873-27ac3a1864df None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:04.672700 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570f7a2-40be-4fc5-a873-27ac3a1864df None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:04.672833 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570f7a2-40be-4fc5-a873-27ac3a1864df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:04.690241 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-a570f7a2-40be-4fc5-a873-27ac3a1864df None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:04.691579 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-a570f7a2-40be-4fc5-a873-27ac3a1864df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:04.762446 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 422/823] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:04 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:04.787805 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22951e98-8f48-4c98-aff1-b7fef83cd507 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:04.888675 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22951e98-8f48-4c98-aff1-b7fef83cd507 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:04.926126 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b4e59-4422-4099-a9c1-51ea4b0a45ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:04.927293 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b4e59-4422-4099-a9c1-51ea4b0a45ba None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:04.927719 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b4e59-4422-4099-a9c1-51ea4b0a45ba None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:04.928131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b4e59-4422-4099-a9c1-51ea4b0a45ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:04.942916 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b4e59-4422-4099-a9c1-51ea4b0a45ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:04.944384 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b4e59-4422-4099-a9c1-51ea4b0a45ba None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-236b4e59-4422-4099-a9c1-51ea4b0a45ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:04.962803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:04.963967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:04.965167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:04.965167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:04.965167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:04.965167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:04.965167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 402/824] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:04.970652 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570f7a2-40be-4fc5-a873-27ac3a1864df None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:05.069038 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570f7a2-40be-4fc5-a873-27ac3a1864df None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:05.094055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:05.102402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4864c-df1b-448f-8a09-655d4a10a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:05.103057 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4864c-df1b-448f-8a09-655d4a10a2da None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:05.103342 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4864c-df1b-448f-8a09-655d4a10a2da None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:05.103622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4864c-df1b-448f-8a09-655d4a10a2da None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:05.104339 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4864c-df1b-448f-8a09-655d4a10a2da None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:05.104648 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4864c-df1b-448f-8a09-655d4a10a2da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:05.106027 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4864c-df1b-448f-8a09-655d4a10a2da None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:05.117466 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 423/825] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:05.123135 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b4e59-4422-4099-a9c1-51ea4b0a45ba None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:05.177333 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:05.221616 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b4e59-4422-4099-a9c1-51ea4b0a45ba None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:05.254408 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901ec45-74e2-4831-95fe-c8291b9fceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:05.255108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ec45-74e2-4831-95fe-c8291b9fceb2 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:05.255392 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ec45-74e2-4831-95fe-c8291b9fceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:05.255935 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ec45-74e2-4831-95fe-c8291b9fceb2 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:05.256647 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901ec45-74e2-4831-95fe-c8291b9fceb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:05.258076 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901ec45-74e2-4831-95fe-c8291b9fceb2 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:05.390477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 403/826] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Jun 6 06:59:05 2022] POST /identity/v3/users => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:59:07.733999 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87970-7bc9-4bbb-bf36-70aea10bc136 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:07.734601 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87970-7bc9-4bbb-bf36-70aea10bc136 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:07.734601 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87970-7bc9-4bbb-bf36-70aea10bc136 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:07.735967 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 424/827] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:07.741170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58f580-1996-454b-a65f-daa4e97bfc77 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:07.741606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58f580-1996-454b-a65f-daa4e97bfc77 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:07.741737 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58f580-1996-454b-a65f-daa4e97bfc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:07.760247 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-bd58f580-1996-454b-a65f-daa4e97bfc77 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:07.762122 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-bd58f580-1996-454b-a65f-daa4e97bfc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:07.831125 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 404/828] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:07 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:07.855736 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce87970-7bc9-4bbb-bf36-70aea10bc136 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:07.957442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce87970-7bc9-4bbb-bf36-70aea10bc136 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:07.992359 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c4f43-9be7-41d5-8ace-bb2f62b3326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:07.993114 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c4f43-9be7-41d5-8ace-bb2f62b3326e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:07.993398 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c4f43-9be7-41d5-8ace-bb2f62b3326e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:07.995948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c4f43-9be7-41d5-8ace-bb2f62b3326e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:08.011731 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c4f43-9be7-41d5-8ace-bb2f62b3326e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-744c4f43-9be7-41d5-8ace-bb2f62b3326e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:59:08.019961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:08.021132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:08.021989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 425/829] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:59:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:08.027465 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58f580-1996-454b-a65f-daa4e97bfc77 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:08.066853 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:08.124411 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58f580-1996-454b-a65f-daa4e97bfc77 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:08.157551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d8e6b-e020-4eea-bf98-cbd693df8f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:08.158210 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d8e6b-e020-4eea-bf98-cbd693df8f46 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:08.158528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d8e6b-e020-4eea-bf98-cbd693df8f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:08.158813 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d8e6b-e020-4eea-bf98-cbd693df8f46 None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:08.159561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d8e6b-e020-4eea-bf98-cbd693df8f46 None admin] RBAC: Adding query filter params (name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:08.159873 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d8e6b-e020-4eea-bf98-cbd693df8f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:08.161242 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d8e6b-e020-4eea-bf98-cbd693df8f46 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:08.169036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 405/830] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:59:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:08.174696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c4f43-9be7-41d5-8ace-bb2f62b3326e None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:08.221109 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:08.273100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c4f43-9be7-41d5-8ace-bb2f62b3326e None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:08.306202 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3fe1c-4937-4d0f-b6f3-140028810335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:08.307041 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3fe1c-4937-4d0f-b6f3-140028810335 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:08.313344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3fe1c-4937-4d0f-b6f3-140028810335 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:08.313344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3fe1c-4937-4d0f-b6f3-140028810335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:08.317930 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3fe1c-4937-4d0f-b6f3-140028810335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:08.319428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3fe1c-4937-4d0f-b6f3-140028810335 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-aba3fe1c-4937-4d0f-b6f3-140028810335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:08.336951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:08.338934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:08.341011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:08.341011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:08.341011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:08.341011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:08.341011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 426/831] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:08.344613 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d8e6b-e020-4eea-bf98-cbd693df8f46 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:08.445649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:08.448732 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d8e6b-e020-4eea-bf98-cbd693df8f46 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:08.482879 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341dc9c-1e96-44d4-b602-592d1eb9378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:08.483530 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341dc9c-1e96-44d4-b602-592d1eb9378b None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:08.483818 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341dc9c-1e96-44d4-b602-592d1eb9378b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:08.484098 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341dc9c-1e96-44d4-b602-592d1eb9378b None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:08.484814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341dc9c-1e96-44d4-b602-592d1eb9378b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:08.485169 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341dc9c-1e96-44d4-b602-592d1eb9378b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:08.486654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341dc9c-1e96-44d4-b602-592d1eb9378b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:08.498632 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 406/832] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:59:08.504229 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3fe1c-4937-4d0f-b6f3-140028810335 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:08.599104 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:08.602932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3fe1c-4937-4d0f-b6f3-140028810335 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:08.636421 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d9c71-9a47-4498-9ccd-3be8c46e97e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:08.637216 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9c71-9a47-4498-9ccd-3be8c46e97e4 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:08.637502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9c71-9a47-4498-9ccd-3be8c46e97e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:08.637783 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9c71-9a47-4498-9ccd-3be8c46e97e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:08.645461 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d9c71-9a47-4498-9ccd-3be8c46e97e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:08.646995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d9c71-9a47-4498-9ccd-3be8c46e97e4 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-898d9c71-9a47-4498-9ccd-3be8c46e97e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:59:08.662049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:08.663123 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:08.664200 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 427/833] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:08.669115 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341dc9c-1e96-44d4-b602-592d1eb9378b None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:08.768944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341dc9c-1e96-44d4-b602-592d1eb9378b None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:08.802846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0761-5214-4865-8351-d7a753c6d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:08.803513 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0761-5214-4865-8351-d7a753c6d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:08.803804 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0761-5214-4865-8351-d7a753c6d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:08.804094 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0761-5214-4865-8351-d7a753c6d8e1 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:08.804928 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f0761-5214-4865-8351-d7a753c6d8e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:08.805243 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f0761-5214-4865-8351-d7a753c6d8e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:08.806703 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f0761-5214-4865-8351-d7a753c6d8e1 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:08.824047 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 407/834] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jun 6 06:59:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:08.829789 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d9c71-9a47-4498-9ccd-3be8c46e97e4 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:08.929424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d9c71-9a47-4498-9ccd-3be8c46e97e4 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:08.963488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b78a35-34a7-408e-be0e-fbf280709355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:08.964130 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b78a35-34a7-408e-be0e-fbf280709355 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:08.964413 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b78a35-34a7-408e-be0e-fbf280709355 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:08.964687 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b78a35-34a7-408e-be0e-fbf280709355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:08.993404 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:09.034956 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b78a35-34a7-408e-be0e-fbf280709355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:09.036442 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b78a35-34a7-408e-be0e-fbf280709355 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:09.133251 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 428/835] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:59:08 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 06:59:09.139049 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0761-5214-4865-8351-d7a753c6d8e1 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:09.157482 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:09.238684 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0761-5214-4865-8351-d7a753c6d8e1 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:09.272181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac517b5-1e92-4696-b5f5-22f2ce63b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:09.272969 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac517b5-1e92-4696-b5f5-22f2ce63b886 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:09.273256 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac517b5-1e92-4696-b5f5-22f2ce63b886 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:09.273536 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac517b5-1e92-4696-b5f5-22f2ce63b886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:09.283391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac517b5-1e92-4696-b5f5-22f2ce63b886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:09.284852 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac517b5-1e92-4696-b5f5-22f2ce63b886 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-2ac517b5-1e92-4696-b5f5-22f2ce63b886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:09.302602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:09.303688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:09.304830 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:09.304830 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:09.304830 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:09.304830 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:09.304830 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 408/836] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:09.309699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b78a35-34a7-408e-be0e-fbf280709355 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:09.367485 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:09.408521 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b78a35-34a7-408e-be0e-fbf280709355 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:09.441654 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d55c8-a3dd-41ed-8339-19bdd48507cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:09.442312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d55c8-a3dd-41ed-8339-19bdd48507cf None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:09.442634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d55c8-a3dd-41ed-8339-19bdd48507cf None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:09.442910 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d55c8-a3dd-41ed-8339-19bdd48507cf None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:09.443628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d55c8-a3dd-41ed-8339-19bdd48507cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:09.443938 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d55c8-a3dd-41ed-8339-19bdd48507cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:09.445288 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d55c8-a3dd-41ed-8339-19bdd48507cf None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:09.456747 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 429/837] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:09.462516 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac517b5-1e92-4696-b5f5-22f2ce63b886 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:09.532799 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:09.562273 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac517b5-1e92-4696-b5f5-22f2ce63b886 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:09.595323 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2e54d-a3ca-453f-b0ec-4cfed6d936f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:09.596106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2e54d-a3ca-453f-b0ec-4cfed6d936f6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:09.596397 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2e54d-a3ca-453f-b0ec-4cfed6d936f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:09.596678 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2e54d-a3ca-453f-b0ec-4cfed6d936f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:09.603207 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2e54d-a3ca-453f-b0ec-4cfed6d936f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:09.604723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2e54d-a3ca-453f-b0ec-4cfed6d936f6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-9ac2e54d-a3ca-453f-b0ec-4cfed6d936f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:59:09.618231 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:09.619302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:09.620651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:59:09.620651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:59:09.620651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:59:09.620651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:59:09.620651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:59:09.620651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:59:09.620651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:09.620651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:09.620651 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 409/838] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:09.625790 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d55c8-a3dd-41ed-8339-19bdd48507cf None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:09.724582 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d55c8-a3dd-41ed-8339-19bdd48507cf None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:09.741752 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:09.758970 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1435bd-b8b6-49f5-9f1a-5359b4c7738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:09.759628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1435bd-b8b6-49f5-9f1a-5359b4c7738e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:09.759918 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1435bd-b8b6-49f5-9f1a-5359b4c7738e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:09.760203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1435bd-b8b6-49f5-9f1a-5359b4c7738e None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:09.760988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1435bd-b8b6-49f5-9f1a-5359b4c7738e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:09.761302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1435bd-b8b6-49f5-9f1a-5359b4c7738e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:09.762770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1435bd-b8b6-49f5-9f1a-5359b4c7738e None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:09.774678 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 430/839] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:09.782089 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2e54d-a3ca-453f-b0ec-4cfed6d936f6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:09.882877 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2e54d-a3ca-453f-b0ec-4cfed6d936f6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:09.910121 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:09.915985 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c91474-f2f4-4499-b88e-557d82570959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:09.916637 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c91474-f2f4-4499-b88e-557d82570959 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:09.916930 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c91474-f2f4-4499-b88e-557d82570959 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:09.917219 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c91474-f2f4-4499-b88e-557d82570959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:09.918027 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c91474-f2f4-4499-b88e-557d82570959 None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=33b6268131ad4545a07647d41b864f3e) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:09.918468 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c91474-f2f4-4499-b88e-557d82570959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:09.920423 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c91474-f2f4-4499-b88e-557d82570959 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:09.925921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 410/840] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:59:09 2022] GET /identity/v3/role_assignments?user.id=33b6268131ad4545a07647d41b864f3e&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:12.199256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71276ae-3e36-4aa7-a532-953e84ac5647 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:12.199774 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71276ae-3e36-4aa7-a532-953e84ac5647 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:12.199774 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71276ae-3e36-4aa7-a532-953e84ac5647 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:12.201170 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 431/841] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:12.206305 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be907ddc-395f-4647-b094-3c870668a718 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:12.206769 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be907ddc-395f-4647-b094-3c870668a718 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:12.206897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be907ddc-395f-4647-b094-3c870668a718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:12.223546 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-be907ddc-395f-4647-b094-3c870668a718 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:12.224744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-be907ddc-395f-4647-b094-3c870668a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:12.291144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 411/842] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:12 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:12.315734 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71276ae-3e36-4aa7-a532-953e84ac5647 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:12.429571 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71276ae-3e36-4aa7-a532-953e84ac5647 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:12.462018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54a885-3485-440d-a016-eb24013f2d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:12.462786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54a885-3485-440d-a016-eb24013f2d34 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:12.463076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54a885-3485-440d-a016-eb24013f2d34 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:12.463357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54a885-3485-440d-a016-eb24013f2d34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:12.474667 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54a885-3485-440d-a016-eb24013f2d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-8a54a885-3485-440d-a016-eb24013f2d34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:59:12.483011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:12.486405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:12.487303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 432/843] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:59:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:12.490166 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be907ddc-395f-4647-b094-3c870668a718 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:12.587845 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be907ddc-395f-4647-b094-3c870668a718 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:12.611812 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:12.622292 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b411-0072-4b2f-9629-c28c0314ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:12.622988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b411-0072-4b2f-9629-c28c0314ef9f None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:12.623285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b411-0072-4b2f-9629-c28c0314ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:12.623570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b411-0072-4b2f-9629-c28c0314ef9f None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:12.624321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b411-0072-4b2f-9629-c28c0314ef9f None admin] RBAC: Adding query filter params (name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:12.624636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b411-0072-4b2f-9629-c28c0314ef9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:12.626025 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b411-0072-4b2f-9629-c28c0314ef9f None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:12.634178 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 412/844] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:59:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:12.640226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54a885-3485-440d-a016-eb24013f2d34 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:12.680869 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:12.745612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54a885-3485-440d-a016-eb24013f2d34 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:12.780698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085cd3-8638-47d7-ab26-8ae56e9af14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:12.781489 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085cd3-8638-47d7-ab26-8ae56e9af14f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:12.781778 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085cd3-8638-47d7-ab26-8ae56e9af14f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:12.782203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab085cd3-8638-47d7-ab26-8ae56e9af14f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:12.792340 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab085cd3-8638-47d7-ab26-8ae56e9af14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:12.793794 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab085cd3-8638-47d7-ab26-8ae56e9af14f None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-ab085cd3-8638-47d7-ab26-8ae56e9af14f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:12.810919 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:12.818281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:12.819394 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:12.819394 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:12.819394 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:12.819394 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:12.819394 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 433/845] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:12.819743 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b411-0072-4b2f-9629-c28c0314ef9f None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:12.918635 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b411-0072-4b2f-9629-c28c0314ef9f None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:12.951956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd7124-8314-4dae-bdb0-b5e7bfdae89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:12.952615 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd7124-8314-4dae-bdb0-b5e7bfdae89a None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:12.952901 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd7124-8314-4dae-bdb0-b5e7bfdae89a None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:12.953180 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd7124-8314-4dae-bdb0-b5e7bfdae89a None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:12.953896 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd7124-8314-4dae-bdb0-b5e7bfdae89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:12.954206 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd7124-8314-4dae-bdb0-b5e7bfdae89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:12.955691 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd7124-8314-4dae-bdb0-b5e7bfdae89a None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:12.967825 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 413/846] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:12.973687 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085cd3-8638-47d7-ab26-8ae56e9af14f None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:13.063736 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:13.072856 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab085cd3-8638-47d7-ab26-8ae56e9af14f None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:13.105984 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5399339-4028-47a3-8c9e-4576cd794cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:13.106815 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5399339-4028-47a3-8c9e-4576cd794cea None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:13.107105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5399339-4028-47a3-8c9e-4576cd794cea None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:13.107411 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5399339-4028-47a3-8c9e-4576cd794cea None admin] PATH_INFO: `/v3/users/placement` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:13.114203 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5399339-4028-47a3-8c9e-4576cd794cea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:13.115701 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5399339-4028-47a3-8c9e-4576cd794cea None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-a5399339-4028-47a3-8c9e-4576cd794cea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:59:13.129992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:13.131419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:13.132366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 434/847] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:13.137620 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd7124-8314-4dae-bdb0-b5e7bfdae89a None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:13.184136 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:13.234862 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd7124-8314-4dae-bdb0-b5e7bfdae89a None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:13.272755 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e1e05-b86c-497b-9915-f2fc1e9c45b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:13.273427 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e1e05-b86c-497b-9915-f2fc1e9c45b6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:13.273720 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e1e05-b86c-497b-9915-f2fc1e9c45b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:13.274005 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e1e05-b86c-497b-9915-f2fc1e9c45b6 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:13.274885 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e1e05-b86c-497b-9915-f2fc1e9c45b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:13.275201 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e1e05-b86c-497b-9915-f2fc1e9c45b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:13.276631 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e1e05-b86c-497b-9915-f2fc1e9c45b6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:13.293747 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 414/848] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jun 6 06:59:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:13.299640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5399339-4028-47a3-8c9e-4576cd794cea None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:13.396768 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5399339-4028-47a3-8c9e-4576cd794cea None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:13.430013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040dfd-5ae9-4022-95d2-ccb9dd407a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:13.430820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040dfd-5ae9-4022-95d2-ccb9dd407a05 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:13.431103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040dfd-5ae9-4022-95d2-ccb9dd407a05 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:13.431379 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040dfd-5ae9-4022-95d2-ccb9dd407a05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:13.441965 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a040dfd-5ae9-4022-95d2-ccb9dd407a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:13.443448 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a040dfd-5ae9-4022-95d2-ccb9dd407a05 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-8a040dfd-5ae9-4022-95d2-ccb9dd407a05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:13.460975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:13.462014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:13.462980 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:13.462980 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:13.462980 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:13.462980 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:13.462980 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 435/849] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:13.467875 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e1e05-b86c-497b-9915-f2fc1e9c45b6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:13.568440 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e1e05-b86c-497b-9915-f2fc1e9c45b6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:13.570865 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:13.601268 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2568fa-d657-42da-accf-25712b9eb6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:13.601929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2568fa-d657-42da-accf-25712b9eb6d2 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:13.602222 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2568fa-d657-42da-accf-25712b9eb6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:13.602537 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2568fa-d657-42da-accf-25712b9eb6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:13.603262 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2568fa-d657-42da-accf-25712b9eb6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:13.603629 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2568fa-d657-42da-accf-25712b9eb6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:13.605060 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2568fa-d657-42da-accf-25712b9eb6d2 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:13.616595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 415/850] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:13.622403 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040dfd-5ae9-4022-95d2-ccb9dd407a05 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:13.625913 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:13.719812 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040dfd-5ae9-4022-95d2-ccb9dd407a05 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:13.756072 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ee6c-68dd-4dd6-b967-38ef57c4f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:13.756858 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ee6c-68dd-4dd6-b967-38ef57c4f913 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:13.757142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ee6c-68dd-4dd6-b967-38ef57c4f913 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:13.757419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ee6c-68dd-4dd6-b967-38ef57c4f913 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:13.764379 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90ee6c-68dd-4dd6-b967-38ef57c4f913 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:13.765814 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90ee6c-68dd-4dd6-b967-38ef57c4f913 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-df90ee6c-68dd-4dd6-b967-38ef57c4f913 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:59:13.779303 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:13.780364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:13.781392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:59:13.781392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:59:13.781392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:59:13.781392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:59:13.781392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:59:13.781392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:59:13.781392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:13.781392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:13.781392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 436/851] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:13.786445 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2568fa-d657-42da-accf-25712b9eb6d2 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:13.885771 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2568fa-d657-42da-accf-25712b9eb6d2 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:13.918922 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52866b5a-18ca-4ac8-a7f4-8ceddab4ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:13.919583 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52866b5a-18ca-4ac8-a7f4-8ceddab4ae20 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:13.920419 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52866b5a-18ca-4ac8-a7f4-8ceddab4ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:13.920702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52866b5a-18ca-4ac8-a7f4-8ceddab4ae20 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:13.921550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52866b5a-18ca-4ac8-a7f4-8ceddab4ae20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:13.921866 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52866b5a-18ca-4ac8-a7f4-8ceddab4ae20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:13.923328 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52866b5a-18ca-4ac8-a7f4-8ceddab4ae20 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:13.935537 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 416/852] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:13.941352 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ee6c-68dd-4dd6-b967-38ef57c4f913 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:14.002314 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:14.039543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ee6c-68dd-4dd6-b967-38ef57c4f913 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:14.072859 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1111d-4772-4bce-979e-afadea3fd097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:14.073764 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1111d-4772-4bce-979e-afadea3fd097 None admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:14.074070 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1111d-4772-4bce-979e-afadea3fd097 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:14.074373 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1111d-4772-4bce-979e-afadea3fd097 None admin] PATH_INFO: `/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/33b6268131ad4545a07647d41b864f3e/roles/cc89d9147f55445ca2cf0a2345259c43` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:14.088951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1111d-4772-4bce-979e-afadea3fd097 None admin] RBAC: Authorizing `identity:create_grant(project_id=518ead35f9cb42f7b67bbe66e16c3236, user_id=33b6268131ad4545a07647d41b864f3e, role_id=cc89d9147f55445ca2cf0a2345259c43)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:14.090402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1111d-4772-4bce-979e-afadea3fd097 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:14.166474 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 437/853] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:59:13 2022] PUT /identity/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/33b6268131ad4545a07647d41b864f3e/roles/cc89d9147f55445ca2cf0a2345259c43 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:59:16.480632 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b14c21-4983-4c76-b7c3-23acf49d5cb7 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:16.481185 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b14c21-4983-4c76-b7c3-23acf49d5cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:16.481185 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b14c21-4983-4c76-b7c3-23acf49d5cb7 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:16.482592 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 417/854] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:16.487817 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514a48-358c-4652-af55-dbd71d98f2ea None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:16.488222 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514a48-358c-4652-af55-dbd71d98f2ea None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:16.488378 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514a48-358c-4652-af55-dbd71d98f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:16.505193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-8e514a48-358c-4652-af55-dbd71d98f2ea None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:16.506686 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-8e514a48-358c-4652-af55-dbd71d98f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:16.574860 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 438/855] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:16 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:16.599984 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b14c21-4983-4c76-b7c3-23acf49d5cb7 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:16.625855 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:16.704978 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b14c21-4983-4c76-b7c3-23acf49d5cb7 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:16.739915 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795fbe2-f5c3-4f90-a8f7-00abad5e2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:16.740637 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795fbe2-f5c3-4f90-a8f7-00abad5e2958 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:16.740925 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795fbe2-f5c3-4f90-a8f7-00abad5e2958 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:16.741202 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795fbe2-f5c3-4f90-a8f7-00abad5e2958 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:16.751931 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795fbe2-f5c3-4f90-a8f7-00abad5e2958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-b795fbe2-f5c3-4f90-a8f7-00abad5e2958 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:59:16.759846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:16.760809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:16.761929 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 418/856] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Jun 6 06:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:16.767217 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514a48-358c-4652-af55-dbd71d98f2ea None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:16.808979 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:16.863515 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514a48-358c-4652-af55-dbd71d98f2ea None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:16.896412 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5a61-9ada-4d97-8dbd-bab810387b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:16.897098 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5a61-9ada-4d97-8dbd-bab810387b0d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:16.897383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5a61-9ada-4d97-8dbd-bab810387b0d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:16.897663 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd5a61-9ada-4d97-8dbd-bab810387b0d None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:16.898443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd5a61-9ada-4d97-8dbd-bab810387b0d None admin] RBAC: Adding query filter params (name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:16.898757 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd5a61-9ada-4d97-8dbd-bab810387b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:16.900132 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd5a61-9ada-4d97-8dbd-bab810387b0d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:16.908646 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 439/857] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Jun 6 06:59:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:16.914321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795fbe2-f5c3-4f90-a8f7-00abad5e2958 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:17.002964 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:17.019588 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795fbe2-f5c3-4f90-a8f7-00abad5e2958 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:17.053360 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c993f-5e7d-4b60-b13d-182e2fa71e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:17.054153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c993f-5e7d-4b60-b13d-182e2fa71e31 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:17.054489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c993f-5e7d-4b60-b13d-182e2fa71e31 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:17.054777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c993f-5e7d-4b60-b13d-182e2fa71e31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:17.064855 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c993f-5e7d-4b60-b13d-182e2fa71e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:17.066320 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c993f-5e7d-4b60-b13d-182e2fa71e31 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-d83c993f-5e7d-4b60-b13d-182e2fa71e31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:17.083572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:17.084709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:17.085792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:17.085792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:17.085792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:17.085792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:17.085792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 419/858] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:17.090480 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5a61-9ada-4d97-8dbd-bab810387b0d None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:17.190048 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd5a61-9ada-4d97-8dbd-bab810387b0d None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:17.192336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:17.222092 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca7257-d299-4c47-8a7b-7d164a3b466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:17.222813 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca7257-d299-4c47-8a7b-7d164a3b466f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:17.223097 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca7257-d299-4c47-8a7b-7d164a3b466f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:17.223374 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca7257-d299-4c47-8a7b-7d164a3b466f None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:17.224086 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca7257-d299-4c47-8a7b-7d164a3b466f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:17.224392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca7257-d299-4c47-8a7b-7d164a3b466f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:17.225910 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca7257-d299-4c47-8a7b-7d164a3b466f None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:17.240291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 440/859] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:17.245961 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c993f-5e7d-4b60-b13d-182e2fa71e31 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:17.353345 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c993f-5e7d-4b60-b13d-182e2fa71e31 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:17.391546 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7572a-f779-41e8-be90-bf83c7049107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:17.392802 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7572a-f779-41e8-be90-bf83c7049107 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:17.393315 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7572a-f779-41e8-be90-bf83c7049107 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:17.393831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7572a-f779-41e8-be90-bf83c7049107 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:17.397849 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:17.402899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7572a-f779-41e8-be90-bf83c7049107 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:17.404338 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7572a-f779-41e8-be90-bf83c7049107 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-08b7572a-f779-41e8-be90-bf83c7049107 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:59:17.418681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:17.420356 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:17.421681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 420/860] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:17.426255 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca7257-d299-4c47-8a7b-7d164a3b466f None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:17.529705 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca7257-d299-4c47-8a7b-7d164a3b466f None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:17.563942 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faf785-ed9d-4553-ae8a-f85c7a93e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:17.564619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faf785-ed9d-4553-ae8a-f85c7a93e968 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:17.564901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faf785-ed9d-4553-ae8a-f85c7a93e968 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:17.565179 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faf785-ed9d-4553-ae8a-f85c7a93e968 None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:17.566008 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faf785-ed9d-4553-ae8a-f85c7a93e968 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:17.566316 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faf785-ed9d-4553-ae8a-f85c7a93e968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:17.567763 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faf785-ed9d-4553-ae8a-f85c7a93e968 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:17.584404 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 441/861] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jun 6 06:59:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:17.590292 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7572a-f779-41e8-be90-bf83c7049107 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:17.689808 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7572a-f779-41e8-be90-bf83c7049107 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:17.723889 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa3a0-ce92-484f-b507-c0f7e7ae5746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:17.724543 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa3a0-ce92-484f-b507-c0f7e7ae5746 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:17.724835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa3a0-ce92-484f-b507-c0f7e7ae5746 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:17.725117 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa3a0-ce92-484f-b507-c0f7e7ae5746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:17.785826 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:17.792289 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aa3a0-ce92-484f-b507-c0f7e7ae5746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:17.793725 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aa3a0-ce92-484f-b507-c0f7e7ae5746 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:17.892549 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 421/862] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:59:17 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 06:59:17.898291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faf785-ed9d-4553-ae8a-f85c7a93e968 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:17.924042 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:17.997572 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faf785-ed9d-4553-ae8a-f85c7a93e968 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:18.033185 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41098f21-fbd4-4061-9fb8-7625b519096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:18.033973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098f21-fbd4-4061-9fb8-7625b519096e None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:18.034260 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098f21-fbd4-4061-9fb8-7625b519096e None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:18.034581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098f21-fbd4-4061-9fb8-7625b519096e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:18.044503 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41098f21-fbd4-4061-9fb8-7625b519096e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:18.046002 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41098f21-fbd4-4061-9fb8-7625b519096e None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-41098f21-fbd4-4061-9fb8-7625b519096e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:18.063139 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:18.066998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:18.068103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:18.068103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:18.068103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:18.068103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:18.068103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 442/863] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:18.069985 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa3a0-ce92-484f-b507-c0f7e7ae5746 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:18.163898 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:18.169492 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa3a0-ce92-484f-b507-c0f7e7ae5746 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:18.201684 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d7e19-fe91-445b-af86-e2af630b5396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:18.202904 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d7e19-fe91-445b-af86-e2af630b5396 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:18.203197 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d7e19-fe91-445b-af86-e2af630b5396 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:18.203478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d7e19-fe91-445b-af86-e2af630b5396 None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:18.204199 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d7e19-fe91-445b-af86-e2af630b5396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:18.204514 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d7e19-fe91-445b-af86-e2af630b5396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:18.205884 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d7e19-fe91-445b-af86-e2af630b5396 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:18.217056 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 422/864] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:18.223169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41098f21-fbd4-4061-9fb8-7625b519096e None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:18.297180 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:18.320699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41098f21-fbd4-4061-9fb8-7625b519096e None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:18.354953 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42f292-1eb7-42e6-a42f-e7da19cfb801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:18.355738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42f292-1eb7-42e6-a42f-e7da19cfb801 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:18.356024 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42f292-1eb7-42e6-a42f-e7da19cfb801 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:18.356306 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42f292-1eb7-42e6-a42f-e7da19cfb801 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:18.362889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42f292-1eb7-42e6-a42f-e7da19cfb801 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:18.364329 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42f292-1eb7-42e6-a42f-e7da19cfb801 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-6c42f292-1eb7-42e6-a42f-e7da19cfb801 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:59:18.378164 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:18.379259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:18.380357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:59:18.380357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:59:18.380357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:59:18.380357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:59:18.380357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:59:18.380357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:59:18.380357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:18.380357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:18.380357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 443/865] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:18.385442 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d7e19-fe91-445b-af86-e2af630b5396 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:18.488657 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d7e19-fe91-445b-af86-e2af630b5396 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:18.522407 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa42191-408b-46ba-b318-c5cd55fad834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:18.523059 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa42191-408b-46ba-b318-c5cd55fad834 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:18.523346 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa42191-408b-46ba-b318-c5cd55fad834 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:18.523628 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa42191-408b-46ba-b318-c5cd55fad834 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:18.524408 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa42191-408b-46ba-b318-c5cd55fad834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:18.524719 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa42191-408b-46ba-b318-c5cd55fad834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:18.526163 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa42191-408b-46ba-b318-c5cd55fad834 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:18.537890 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 423/866] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:18.544891 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42f292-1eb7-42e6-a42f-e7da19cfb801 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:18.645568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42f292-1eb7-42e6-a42f-e7da19cfb801 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:18.678447 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947028af-b962-4982-8f24-64d118e5e164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:18.679151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947028af-b962-4982-8f24-64d118e5e164 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:18.679595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947028af-b962-4982-8f24-64d118e5e164 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:18.679884 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947028af-b962-4982-8f24-64d118e5e164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:18.680721 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947028af-b962-4982-8f24-64d118e5e164 None admin] RBAC: Adding query filter params (role.id=cc89d9147f55445ca2cf0a2345259c43, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=33b6268131ad4545a07647d41b864f3e) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:18.681040 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947028af-b962-4982-8f24-64d118e5e164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:18.682526 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947028af-b962-4982-8f24-64d118e5e164 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:18.684416 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:18.689579 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 444/867] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:59:18 2022] GET /identity/v3/role_assignments?user.id=33b6268131ad4545a07647d41b864f3e&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=cc89d9147f55445ca2cf0a2345259c43 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:21.048476 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596481bd-fc99-4fd1-a43b-22b913739f35 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:21.049033 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596481bd-fc99-4fd1-a43b-22b913739f35 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:21.049033 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596481bd-fc99-4fd1-a43b-22b913739f35 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:21.050433 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 424/868] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:21.055562 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8042a2a-d534-45b0-960e-18927de5b5b2 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:21.055940 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8042a2a-d534-45b0-960e-18927de5b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:21.056121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8042a2a-d534-45b0-960e-18927de5b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:21.073297 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-a8042a2a-d534-45b0-960e-18927de5b5b2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:21.074526 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-a8042a2a-d534-45b0-960e-18927de5b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:21.140646 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 445/869] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:21 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:21.165845 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596481bd-fc99-4fd1-a43b-22b913739f35 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:21.183766 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:21.266537 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596481bd-fc99-4fd1-a43b-22b913739f35 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:21.299479 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8287-eb56-4894-af68-1833ced477c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:21.300267 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8287-eb56-4894-af68-1833ced477c2 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:21.300551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8287-eb56-4894-af68-1833ced477c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:21.300832 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8287-eb56-4894-af68-1833ced477c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:21.311007 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac8287-eb56-4894-af68-1833ced477c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-0dac8287-eb56-4894-af68-1833ced477c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:59:21.318686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:21.330977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:21.332024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 425/870] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:59:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:21.332885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8042a2a-d534-45b0-960e-18927de5b5b2 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:21.423731 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8042a2a-d534-45b0-960e-18927de5b5b2 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:21.449856 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:21.458074 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4818d7a-2aa6-4ea6-9c08-5e76e7329274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:21.458784 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4818d7a-2aa6-4ea6-9c08-5e76e7329274 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:21.459073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4818d7a-2aa6-4ea6-9c08-5e76e7329274 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:21.459355 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4818d7a-2aa6-4ea6-9c08-5e76e7329274 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:21.460105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4818d7a-2aa6-4ea6-9c08-5e76e7329274 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:21.460415 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4818d7a-2aa6-4ea6-9c08-5e76e7329274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:21.461786 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4818d7a-2aa6-4ea6-9c08-5e76e7329274 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:21.469641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 446/871] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:21.475391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8287-eb56-4894-af68-1833ced477c2 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:21.552199 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:21.574470 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8287-eb56-4894-af68-1833ced477c2 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:21.608384 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3efe3-4738-4589-ae08-7bc32678a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:21.609380 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3efe3-4738-4589-ae08-7bc32678a04e None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:21.609859 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3efe3-4738-4589-ae08-7bc32678a04e None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:21.610283 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3efe3-4738-4589-ae08-7bc32678a04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:21.621216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3efe3-4738-4589-ae08-7bc32678a04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:21.622834 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3efe3-4738-4589-ae08-7bc32678a04e None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-c4f3efe3-4738-4589-ae08-7bc32678a04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:21.641614 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:21.642702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:21.643831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:21.643831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:21.643831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:21.643831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:21.643831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 426/872] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 06 06:59:21.648543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4818d7a-2aa6-4ea6-9c08-5e76e7329274 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:21.746397 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4818d7a-2aa6-4ea6-9c08-5e76e7329274 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:21.781564 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62896f17-d803-4281-a902-b6efc7a8e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:21.782213 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62896f17-d803-4281-a902-b6efc7a8e60c None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:21.782588 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62896f17-d803-4281-a902-b6efc7a8e60c None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:21.782906 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62896f17-d803-4281-a902-b6efc7a8e60c None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:21.783805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62896f17-d803-4281-a902-b6efc7a8e60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:21.784129 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62896f17-d803-4281-a902-b6efc7a8e60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:21.785528 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62896f17-d803-4281-a902-b6efc7a8e60c None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:21.797970 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 447/873] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:59:21.803578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3efe3-4738-4589-ae08-7bc32678a04e None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:21.903059 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3efe3-4738-4589-ae08-7bc32678a04e None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:21.929736 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:21.938174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d21a8-3d12-4212-874e-0a207defb12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:21.939015 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d21a8-3d12-4212-874e-0a207defb12c None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:21.939309 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d21a8-3d12-4212-874e-0a207defb12c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:21.939590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d21a8-3d12-4212-874e-0a207defb12c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:21.947269 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d21a8-3d12-4212-874e-0a207defb12c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:21.948724 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d21a8-3d12-4212-874e-0a207defb12c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-526d21a8-3d12-4212-874e-0a207defb12c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:59:21.963735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:21.964706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:21.965779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 427/874] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:21.970966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62896f17-d803-4281-a902-b6efc7a8e60c None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:22.021351 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:22.070261 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62896f17-d803-4281-a902-b6efc7a8e60c None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:22.103847 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c9035-33e6-4463-945d-2e72de483ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:22.104512 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c9035-33e6-4463-945d-2e72de483ccc None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:22.104799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c9035-33e6-4463-945d-2e72de483ccc None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:22.105082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c9035-33e6-4463-945d-2e72de483ccc None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:22.105914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c9035-33e6-4463-945d-2e72de483ccc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:22.106230 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c9035-33e6-4463-945d-2e72de483ccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:22.107829 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c9035-33e6-4463-945d-2e72de483ccc None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:22.125174 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 448/875] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jun 6 06:59:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:59:22.130905 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d21a8-3d12-4212-874e-0a207defb12c None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:22.230922 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d21a8-3d12-4212-874e-0a207defb12c None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:22.263811 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35072a-4ee3-4ed0-ba52-e12a356a9d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:22.264458 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35072a-4ee3-4ed0-ba52-e12a356a9d47 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:22.264750 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35072a-4ee3-4ed0-ba52-e12a356a9d47 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:22.265028 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35072a-4ee3-4ed0-ba52-e12a356a9d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:22.320018 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:22.331899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35072a-4ee3-4ed0-ba52-e12a356a9d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:22.333341 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35072a-4ee3-4ed0-ba52-e12a356a9d47 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:22.431898 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 428/876] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:59:22 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 06:59:22.438651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c9035-33e6-4463-945d-2e72de483ccc None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:22.537461 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c9035-33e6-4463-945d-2e72de483ccc None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:22.546478 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:22.570205 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de529f-244a-479c-b7ce-c0788311face None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:22.570970 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de529f-244a-479c-b7ce-c0788311face None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:22.571291 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de529f-244a-479c-b7ce-c0788311face None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:22.572537 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de529f-244a-479c-b7ce-c0788311face None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:22.582820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de529f-244a-479c-b7ce-c0788311face None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:22.584258 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de529f-244a-479c-b7ce-c0788311face None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-37de529f-244a-479c-b7ce-c0788311face None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:22.602443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:22.603477 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:22.604710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:22.604710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:22.604710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:22.604710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:22.604710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 449/877] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:22.609285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35072a-4ee3-4ed0-ba52-e12a356a9d47 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:22.696769 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:22.708911 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35072a-4ee3-4ed0-ba52-e12a356a9d47 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:22.741578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c7e0b-4726-4fd7-91c6-e88f94eb63cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:22.742236 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7e0b-4726-4fd7-91c6-e88f94eb63cf None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:22.742559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7e0b-4726-4fd7-91c6-e88f94eb63cf None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:22.742847 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c7e0b-4726-4fd7-91c6-e88f94eb63cf None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:22.743576 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c7e0b-4726-4fd7-91c6-e88f94eb63cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:22.743897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c7e0b-4726-4fd7-91c6-e88f94eb63cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:22.745261 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c7e0b-4726-4fd7-91c6-e88f94eb63cf None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:22.756593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 429/878] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:22.762295 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de529f-244a-479c-b7ce-c0788311face None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:22.861285 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de529f-244a-479c-b7ce-c0788311face None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:22.895565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74098-4813-4eea-93bb-3594b908144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:22.896383 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74098-4813-4eea-93bb-3594b908144b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:22.896672 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74098-4813-4eea-93bb-3594b908144b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:22.896953 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74098-4813-4eea-93bb-3594b908144b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:22.903501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f74098-4813-4eea-93bb-3594b908144b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:22.904941 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f74098-4813-4eea-93bb-3594b908144b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-24f74098-4813-4eea-93bb-3594b908144b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:59:22.918440 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:22.919487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:22.920631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:59:22.920631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:59:22.920631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:59:22.920631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:59:22.920631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:59:22.920631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:59:22.920631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:22.920631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:22.920631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 450/879] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:59:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:22.925567 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c7e0b-4726-4fd7-91c6-e88f94eb63cf None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:23.024686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c7e0b-4726-4fd7-91c6-e88f94eb63cf None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:23.056992 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600cf0e-827d-4036-b533-6494cc0748c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:23.057649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600cf0e-827d-4036-b533-6494cc0748c8 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:23.057938 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600cf0e-827d-4036-b533-6494cc0748c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:23.058220 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600cf0e-827d-4036-b533-6494cc0748c8 None admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:23.059035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600cf0e-827d-4036-b533-6494cc0748c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:23.059349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600cf0e-827d-4036-b533-6494cc0748c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:23.060778 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600cf0e-827d-4036-b533-6494cc0748c8 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:23.073041 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 430/880] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:59:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:23.079723 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74098-4813-4eea-93bb-3594b908144b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:23.101637 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:23.176431 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74098-4813-4eea-93bb-3594b908144b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:23.209336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9868-f984-4c77-8e02-73bc9d4b3b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:23.209974 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9868-f984-4c77-8e02-73bc9d4b3b8d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:23.210256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9868-f984-4c77-8e02-73bc9d4b3b8d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:23.210561 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9868-f984-4c77-8e02-73bc9d4b3b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:23.211434 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9868-f984-4c77-8e02-73bc9d4b3b8d None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=33b6268131ad4545a07647d41b864f3e) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:23.211937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9868-f984-4c77-8e02-73bc9d4b3b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:23.214150 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9868-f984-4c77-8e02-73bc9d4b3b8d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:23.219666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 451/881] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:59:23 2022] GET /identity/v3/role_assignments?user.id=33b6268131ad4545a07647d41b864f3e&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:59:25.510653 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a8e57-ccac-4d33-8fbf-43b346ea70cf None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:25.511182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a8e57-ccac-4d33-8fbf-43b346ea70cf None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:25.511297 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a8e57-ccac-4d33-8fbf-43b346ea70cf None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:25.512566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 431/882] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:25.517941 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020215-96ea-4ccd-9a95-9c81dd463ac2 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:25.518401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020215-96ea-4ccd-9a95-9c81dd463ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:25.518519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020215-96ea-4ccd-9a95-9c81dd463ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:25.535517 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-66020215-96ea-4ccd-9a95-9c81dd463ac2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:25.536686 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-66020215-96ea-4ccd-9a95-9c81dd463ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:25.602309 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 452/883] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:25 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:25.627665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a8e57-ccac-4d33-8fbf-43b346ea70cf None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:25.639053 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:25.730153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a8e57-ccac-4d33-8fbf-43b346ea70cf None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:25.764233 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ced2d2-c571-4fe7-844c-de6ae8f3de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:25.764965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced2d2-c571-4fe7-844c-de6ae8f3de80 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:25.765256 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced2d2-c571-4fe7-844c-de6ae8f3de80 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:25.765565 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced2d2-c571-4fe7-844c-de6ae8f3de80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:25.777312 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ced2d2-c571-4fe7-844c-de6ae8f3de80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-49ced2d2-c571-4fe7-844c-de6ae8f3de80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:59:25.785086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:25.786191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:25.787271 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 432/884] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:25.792331 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66020215-96ea-4ccd-9a95-9c81dd463ac2 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:25.807633 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:25.888726 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66020215-96ea-4ccd-9a95-9c81dd463ac2 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:25.924285 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ac2e1-05e7-425b-873a-d8bd8dfafd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:25.924977 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ac2e1-05e7-425b-873a-d8bd8dfafd32 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:25.925260 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ac2e1-05e7-425b-873a-d8bd8dfafd32 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:25.925536 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ac2e1-05e7-425b-873a-d8bd8dfafd32 None admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:25.926296 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ac2e1-05e7-425b-873a-d8bd8dfafd32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:25.926640 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ac2e1-05e7-425b-873a-d8bd8dfafd32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:25.928038 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ac2e1-05e7-425b-873a-d8bd8dfafd32 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:25.936506 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 453/885] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:25.942553 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ced2d2-c571-4fe7-844c-de6ae8f3de80 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:26.008249 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:26.042253 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ced2d2-c571-4fe7-844c-de6ae8f3de80 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:26.076574 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834d0f-f287-42fa-8312-64addae9b360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:26.077372 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834d0f-f287-42fa-8312-64addae9b360 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:26.077666 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834d0f-f287-42fa-8312-64addae9b360 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:26.077979 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834d0f-f287-42fa-8312-64addae9b360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:26.088509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c834d0f-f287-42fa-8312-64addae9b360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:26.089975 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c834d0f-f287-42fa-8312-64addae9b360 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-2c834d0f-f287-42fa-8312-64addae9b360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:26.107299 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:26.108450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:26.109990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:26.109990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:26.109990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:26.109990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:26.109990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 433/886] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:26.114836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ac2e1-05e7-425b-873a-d8bd8dfafd32 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:26.193027 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:26.214609 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ac2e1-05e7-425b-873a-d8bd8dfafd32 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:26.247226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa42340-bf0c-4d01-a2ae-4236c3ca281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:26.247885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa42340-bf0c-4d01-a2ae-4236c3ca281f None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:26.248173 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa42340-bf0c-4d01-a2ae-4236c3ca281f None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:26.248451 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa42340-bf0c-4d01-a2ae-4236c3ca281f None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:26.249165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa42340-bf0c-4d01-a2ae-4236c3ca281f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:26.249474 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa42340-bf0c-4d01-a2ae-4236c3ca281f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:26.250927 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa42340-bf0c-4d01-a2ae-4236c3ca281f None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:26.263131 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 454/887] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:26.269296 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834d0f-f287-42fa-8312-64addae9b360 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:26.368662 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834d0f-f287-42fa-8312-64addae9b360 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:26.388196 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:26.402132 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5abcc1-347c-4611-8420-abed51344de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:26.402983 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5abcc1-347c-4611-8420-abed51344de0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:26.403275 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5abcc1-347c-4611-8420-abed51344de0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:26.403562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5abcc1-347c-4611-8420-abed51344de0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:26.414688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5abcc1-347c-4611-8420-abed51344de0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:26.416141 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5abcc1-347c-4611-8420-abed51344de0 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-cc5abcc1-347c-4611-8420-abed51344de0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:59:26.430509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:26.433464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:26.434477 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 434/888] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:26.437776 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa42340-bf0c-4d01-a2ae-4236c3ca281f None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:26.539153 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa42340-bf0c-4d01-a2ae-4236c3ca281f None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:26.571619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403e549-e7e9-4a27-affb-1a6c16e41ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:26.572302 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403e549-e7e9-4a27-affb-1a6c16e41ab8 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:26.572590 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403e549-e7e9-4a27-affb-1a6c16e41ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:26.572872 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403e549-e7e9-4a27-affb-1a6c16e41ab8 None admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:26.573743 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403e549-e7e9-4a27-affb-1a6c16e41ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:26.574055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403e549-e7e9-4a27-affb-1a6c16e41ab8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:26.575541 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403e549-e7e9-4a27-affb-1a6c16e41ab8 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:26.578837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:26.593216 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 455/889] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jun 6 06:59:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:59:26.600008 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5abcc1-347c-4611-8420-abed51344de0 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:26.700777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5abcc1-347c-4611-8420-abed51344de0 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:26.734774 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8c2a4-a3a0-42e4-a31a-ea1a822fdbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:26.735561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8c2a4-a3a0-42e4-a31a-ea1a822fdbb0 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:26.735848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8c2a4-a3a0-42e4-a31a-ea1a822fdbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:26.736127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8c2a4-a3a0-42e4-a31a-ea1a822fdbb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:26.746910 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8c2a4-a3a0-42e4-a31a-ea1a822fdbb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:26.748360 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8c2a4-a3a0-42e4-a31a-ea1a822fdbb0 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-78a8c2a4-a3a0-42e4-a31a-ea1a822fdbb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:26.766519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:26.767559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:26.768649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:26.768649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:26.768649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:26.768649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:26.768649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 435/890] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:26.773578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403e549-e7e9-4a27-affb-1a6c16e41ab8 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:26.872686 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403e549-e7e9-4a27-affb-1a6c16e41ab8 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:26.906805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072c75b-aa75-4c48-8bf5-02032eec5061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:26.907471 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072c75b-aa75-4c48-8bf5-02032eec5061 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:26.907762 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072c75b-aa75-4c48-8bf5-02032eec5061 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:26.908046 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072c75b-aa75-4c48-8bf5-02032eec5061 None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:26.908777 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072c75b-aa75-4c48-8bf5-02032eec5061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:26.909091 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072c75b-aa75-4c48-8bf5-02032eec5061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:26.910498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072c75b-aa75-4c48-8bf5-02032eec5061 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:26.921995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 456/891] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:26.927772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8c2a4-a3a0-42e4-a31a-ea1a822fdbb0 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:26.960358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:27.027377 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8c2a4-a3a0-42e4-a31a-ea1a822fdbb0 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:27.061660 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca454ab-4e22-4e45-ba07-4eb72c234fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:27.063157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca454ab-4e22-4e45-ba07-4eb72c234fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:27.063445 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca454ab-4e22-4e45-ba07-4eb72c234fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:27.063722 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca454ab-4e22-4e45-ba07-4eb72c234fd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:27.070468 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca454ab-4e22-4e45-ba07-4eb72c234fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:27.071897 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca454ab-4e22-4e45-ba07-4eb72c234fd5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-6ca454ab-4e22-4e45-ba07-4eb72c234fd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:59:27.085404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:27.086484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:27.087554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:59:27.087554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:59:27.087554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:59:27.087554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:59:27.087554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:59:27.087554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:59:27.087554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:27.087554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:27.087554 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 436/892] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:27.092535 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072c75b-aa75-4c48-8bf5-02032eec5061 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:27.147836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:27.196744 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072c75b-aa75-4c48-8bf5-02032eec5061 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:27.229634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043f5cd-fb6d-4a49-9cd9-f0fab96076ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:27.230261 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043f5cd-fb6d-4a49-9cd9-f0fab96076ee None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:27.230582 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043f5cd-fb6d-4a49-9cd9-f0fab96076ee None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:27.230865 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043f5cd-fb6d-4a49-9cd9-f0fab96076ee None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:27.231653 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043f5cd-fb6d-4a49-9cd9-f0fab96076ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:27.231965 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043f5cd-fb6d-4a49-9cd9-f0fab96076ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:27.233391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043f5cd-fb6d-4a49-9cd9-f0fab96076ee None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:27.246090 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 457/893] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:27.252489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca454ab-4e22-4e45-ba07-4eb72c234fd5 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:27.342443 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:27.351381 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca454ab-4e22-4e45-ba07-4eb72c234fd5 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:27.386510 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b8b8f-798b-44ee-9291-93acc83c2d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:27.387392 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8b8f-798b-44ee-9291-93acc83c2d2b None admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:27.387679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8b8f-798b-44ee-9291-93acc83c2d2b None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:27.387960 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8b8f-798b-44ee-9291-93acc83c2d2b None admin] PATH_INFO: `/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/33b6268131ad4545a07647d41b864f3e/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:27.390048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b8b8f-798b-44ee-9291-93acc83c2d2b None admin] RBAC: Authorizing `identity:create_grant(project_id=518ead35f9cb42f7b67bbe66e16c3236, user_id=33b6268131ad4545a07647d41b864f3e, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:27.391508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b8b8f-798b-44ee-9291-93acc83c2d2b None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:27.504471 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 437/894] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Jun 6 06:59:27 2022] PUT /identity/v3/projects/518ead35f9cb42f7b67bbe66e16c3236/users/33b6268131ad4545a07647d41b864f3e/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 06:59:29.817494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f307606-cb34-44fc-ad04-9ebe834812f4 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:29.818050 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f307606-cb34-44fc-ad04-9ebe834812f4 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:29.818050 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f307606-cb34-44fc-ad04-9ebe834812f4 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:29.819458 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 458/895] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:29.825013 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef58c85-08b0-4b8f-ba2e-b46078f43052 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:29.825433 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef58c85-08b0-4b8f-ba2e-b46078f43052 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:29.825583 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef58c85-08b0-4b8f-ba2e-b46078f43052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:29.842567 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-bef58c85-08b0-4b8f-ba2e-b46078f43052 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:29.844379 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-bef58c85-08b0-4b8f-ba2e-b46078f43052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:29.910837 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 438/896] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:29.935570 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f307606-cb34-44fc-ad04-9ebe834812f4 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:30.035227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f307606-cb34-44fc-ad04-9ebe834812f4 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:30.048939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:30.068331 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a363ebd-3d36-4c9d-afb6-8d81a287a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:30.069050 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a363ebd-3d36-4c9d-afb6-8d81a287a6dd None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:30.069333 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a363ebd-3d36-4c9d-afb6-8d81a287a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:30.069610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a363ebd-3d36-4c9d-afb6-8d81a287a6dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:30.079932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a363ebd-3d36-4c9d-afb6-8d81a287a6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-0a363ebd-3d36-4c9d-afb6-8d81a287a6dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 06 06:59:30.087401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:30.088502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:30.089391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 459/897] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Jun 6 06:59:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:30.094470 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef58c85-08b0-4b8f-ba2e-b46078f43052 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:30.173470 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:30.191161 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef58c85-08b0-4b8f-ba2e-b46078f43052 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:30.225151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855607a-ae57-42ca-9514-7e9c8ca5a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:30.225824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855607a-ae57-42ca-9514-7e9c8ca5a22c None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:30.226112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855607a-ae57-42ca-9514-7e9c8ca5a22c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:30.226423 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855607a-ae57-42ca-9514-7e9c8ca5a22c None admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:30.227177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855607a-ae57-42ca-9514-7e9c8ca5a22c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:30.227488 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855607a-ae57-42ca-9514-7e9c8ca5a22c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:30.228879 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855607a-ae57-42ca-9514-7e9c8ca5a22c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:30.237646 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 439/898] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Jun 6 06:59:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:30.243400 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a363ebd-3d36-4c9d-afb6-8d81a287a6dd None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:30.343997 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a363ebd-3d36-4c9d-afb6-8d81a287a6dd None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:30.377293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63415a-8bee-44b8-81f4-3d94ecc63571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:30.378108 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63415a-8bee-44b8-81f4-3d94ecc63571 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:30.378450 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63415a-8bee-44b8-81f4-3d94ecc63571 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:30.378737 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63415a-8bee-44b8-81f4-3d94ecc63571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:30.389281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63415a-8bee-44b8-81f4-3d94ecc63571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:30.390776 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63415a-8bee-44b8-81f4-3d94ecc63571 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-7a63415a-8bee-44b8-81f4-3d94ecc63571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:30.407433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:30.408497 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:30.409598 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:30.409598 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:30.409598 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:30.409598 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:30.409598 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 460/899] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:30.414371 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855607a-ae57-42ca-9514-7e9c8ca5a22c None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:30.517153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855607a-ae57-42ca-9514-7e9c8ca5a22c None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:30.550909 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc2a04-e588-42eb-9616-0d00610475ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:30.551602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc2a04-e588-42eb-9616-0d00610475ee None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:30.552081 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc2a04-e588-42eb-9616-0d00610475ee None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:30.552576 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc2a04-e588-42eb-9616-0d00610475ee None admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:30.553321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc2a04-e588-42eb-9616-0d00610475ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:30.553634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc2a04-e588-42eb-9616-0d00610475ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:30.555027 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc2a04-e588-42eb-9616-0d00610475ee None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:30.567779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 440/900] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:30.573437 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63415a-8bee-44b8-81f4-3d94ecc63571 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:30.601252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:30.674056 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63415a-8bee-44b8-81f4-3d94ecc63571 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:30.707264 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660483e0-95be-4bb1-a6fe-86a905b0e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:30.708090 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660483e0-95be-4bb1-a6fe-86a905b0e6b3 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:30.708418 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660483e0-95be-4bb1-a6fe-86a905b0e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:30.708699 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660483e0-95be-4bb1-a6fe-86a905b0e6b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:30.715614 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660483e0-95be-4bb1-a6fe-86a905b0e6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:30.717108 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660483e0-95be-4bb1-a6fe-86a905b0e6b3 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-660483e0-95be-4bb1-a6fe-86a905b0e6b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 06 06:59:30.731492 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:30.732622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:30.733603 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 461/901] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:30.739100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc2a04-e588-42eb-9616-0d00610475ee None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:30.742907 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:30.841035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc2a04-e588-42eb-9616-0d00610475ee None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:30.877068 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b70bd-549e-4554-874f-9a1f1c7bf512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:30.877672 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b70bd-549e-4554-874f-9a1f1c7bf512 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:30.877956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b70bd-549e-4554-874f-9a1f1c7bf512 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:30.878229 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b70bd-549e-4554-874f-9a1f1c7bf512 None admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:30.879084 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b70bd-549e-4554-874f-9a1f1c7bf512 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:30.879392 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b70bd-549e-4554-874f-9a1f1c7bf512 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:30.880887 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b70bd-549e-4554-874f-9a1f1c7bf512 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:30.898155 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 441/902] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Jun 6 06:59:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:30.903942 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660483e0-95be-4bb1-a6fe-86a905b0e6b3 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:30.989089 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:31.003592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660483e0-95be-4bb1-a6fe-86a905b0e6b3 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:31.036490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cbe54-c23c-499e-9b4e-9c202681fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:31.037128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cbe54-c23c-499e-9b4e-9c202681fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:31.037411 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cbe54-c23c-499e-9b4e-9c202681fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:31.037688 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cbe54-c23c-499e-9b4e-9c202681fdb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:31.103437 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cbe54-c23c-499e-9b4e-9c202681fdb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:31.104881 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cbe54-c23c-499e-9b4e-9c202681fdb7 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:31.185405 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:31.200076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 462/903] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Jun 6 06:59:30 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 06 06:59:31.206319 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b70bd-549e-4554-874f-9a1f1c7bf512 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:31.266640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:31.303575 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b70bd-549e-4554-874f-9a1f1c7bf512 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:31.336413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e7bfd-06f1-46b0-bd0b-a683d8208f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:31.337203 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e7bfd-06f1-46b0-bd0b-a683d8208f3c None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:31.337489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e7bfd-06f1-46b0-bd0b-a683d8208f3c None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:31.337772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e7bfd-06f1-46b0-bd0b-a683d8208f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:31.349260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e7bfd-06f1-46b0-bd0b-a683d8208f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:31.350720 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e7bfd-06f1-46b0-bd0b-a683d8208f3c None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-622e7bfd-06f1-46b0-bd0b-a683d8208f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 06 06:59:31.368216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:31.374562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:31.376112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 06 06:59:31.376112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 06 06:59:31.376112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 06 06:59:31.376112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:31.376112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 442/904] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 06:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:31.376387 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cbe54-c23c-499e-9b4e-9c202681fdb7 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:31.472356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cbe54-c23c-499e-9b4e-9c202681fdb7 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:31.506736 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe6c3-ae3a-420f-9d66-60070d77064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:31.507384 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe6c3-ae3a-420f-9d66-60070d77064b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:31.507667 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe6c3-ae3a-420f-9d66-60070d77064b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:31.507942 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe6c3-ae3a-420f-9d66-60070d77064b None admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:31.508650 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fe6c3-ae3a-420f-9d66-60070d77064b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:31.508957 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fe6c3-ae3a-420f-9d66-60070d77064b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:31.510393 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fe6c3-ae3a-420f-9d66-60070d77064b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:31.521292 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 463/905] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Jun 6 06:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:31.526846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e7bfd-06f1-46b0-bd0b-a683d8208f3c None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:31.628711 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e7bfd-06f1-46b0-bd0b-a683d8208f3c None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:31.642653 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:31.662699 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42f3d0-c129-4e7c-906c-5dd86892a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:31.663615 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f3d0-c129-4e7c-906c-5dd86892a5a6 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:31.664056 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f3d0-c129-4e7c-906c-5dd86892a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:31.664269 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42f3d0-c129-4e7c-906c-5dd86892a5a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:31.671492 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42f3d0-c129-4e7c-906c-5dd86892a5a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:31.673603 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42f3d0-c129-4e7c-906c-5dd86892a5a6 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application [None req-9d42f3d0-c129-4e7c-906c-5dd86892a5a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 06 06:59:31.687449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:31.688483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:31.689463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 06 06:59:31.689463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 06 06:59:31.689463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 06 06:59:31.689463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 06 06:59:31.689463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 06 06:59:31.689463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 06 06:59:31.689463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 06 06:59:31.689463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: ERROR keystone.server.flask.application Jun 06 06:59:31.689463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 443/906] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Jun 6 06:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:31.694555 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe6c3-ae3a-420f-9d66-60070d77064b None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:31.742296 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:31.796193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe6c3-ae3a-420f-9d66-60070d77064b None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:31.828948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9aa142-b8b6-444e-aa40-546eb857370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:31.829599 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aa142-b8b6-444e-aa40-546eb857370b None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:31.829883 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aa142-b8b6-444e-aa40-546eb857370b None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:31.830161 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9aa142-b8b6-444e-aa40-546eb857370b None admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:31.830974 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9aa142-b8b6-444e-aa40-546eb857370b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:31.831283 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9aa142-b8b6-444e-aa40-546eb857370b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:31.832708 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9aa142-b8b6-444e-aa40-546eb857370b None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:31.844968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 464/907] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Jun 6 06:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:31.851468 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42f3d0-c129-4e7c-906c-5dd86892a5a6 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:31.953052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42f3d0-c129-4e7c-906c-5dd86892a5a6 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:31.987175 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea519ece-ee90-46c8-80a9-266fd6c654de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:31.987828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519ece-ee90-46c8-80a9-266fd6c654de None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:31.988118 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519ece-ee90-46c8-80a9-266fd6c654de None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:31.988400 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea519ece-ee90-46c8-80a9-266fd6c654de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:31.989229 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea519ece-ee90-46c8-80a9-266fd6c654de None admin] RBAC: Adding query filter params (role.id=7e6b1b3c63c9411fb0e9bdbab192bbac, scope.project.id=518ead35f9cb42f7b67bbe66e16c3236, user.id=33b6268131ad4545a07647d41b864f3e) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:31.989549 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea519ece-ee90-46c8-80a9-266fd6c654de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:31.991024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea519ece-ee90-46c8-80a9-266fd6c654de None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:31.996911 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 444/908] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Jun 6 06:59:31 2022] GET /identity/v3/role_assignments?user.id=33b6268131ad4545a07647d41b864f3e&scope.project.id=518ead35f9cb42f7b67bbe66e16c3236&role.id=7e6b1b3c63c9411fb0e9bdbab192bbac => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:34.349075 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478ce4-a183-40c0-a086-0af044dd9a6a None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:34.349645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478ce4-a183-40c0-a086-0af044dd9a6a None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:34.349645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478ce4-a183-40c0-a086-0af044dd9a6a None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:34.351052 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 465/909] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:34.356349 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2197f-6e96-47f2-b739-aabd37d81b20 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:34.356782 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2197f-6e96-47f2-b739-aabd37d81b20 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:34.356917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2197f-6e96-47f2-b739-aabd37d81b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:34.373961 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-01e2197f-6e96-47f2-b739-aabd37d81b20 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:34.375803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-01e2197f-6e96-47f2-b739-aabd37d81b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:34.404657 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:34.441440 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 445/910] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:34 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 06 06:59:34.465085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478ce4-a183-40c0-a086-0af044dd9a6a None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:34.593622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478ce4-a183-40c0-a086-0af044dd9a6a None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:34.607119 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:34.627600 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45591ae3-c7d2-439d-bb46-490bce327cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:34.628395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45591ae3-c7d2-439d-bb46-490bce327cee None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:34.628685 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45591ae3-c7d2-439d-bb46-490bce327cee None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:34.628966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45591ae3-c7d2-439d-bb46-490bce327cee None admin] PATH_INFO: `/v3/services/placement` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:34.629622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45591ae3-c7d2-439d-bb46-490bce327cee None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:34.631013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45591ae3-c7d2-439d-bb46-490bce327cee None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-45591ae3-c7d2-439d-bb46-490bce327cee None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:34.642807 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:34.644016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:34.644968 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 466/911] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jun 6 06:59:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:34.650131 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2197f-6e96-47f2-b739-aabd37d81b20 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:34.751011 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2197f-6e96-47f2-b739-aabd37d81b20 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:34.784694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40122ca-5d84-4c29-901a-6d8e6eae19fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:34.785355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40122ca-5d84-4c29-901a-6d8e6eae19fe None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:34.785645 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40122ca-5d84-4c29-901a-6d8e6eae19fe None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:34.785923 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40122ca-5d84-4c29-901a-6d8e6eae19fe None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:34.786673 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40122ca-5d84-4c29-901a-6d8e6eae19fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:34.786986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40122ca-5d84-4c29-901a-6d8e6eae19fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:34.788398 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40122ca-5d84-4c29-901a-6d8e6eae19fe None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:34.793078 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 446/912] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Jun 6 06:59:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:34.799533 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45591ae3-c7d2-439d-bb46-490bce327cee None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:34.899988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45591ae3-c7d2-439d-bb46-490bce327cee None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:34.933911 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc5522-a790-4063-8876-5307b70fb107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:34.934620 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc5522-a790-4063-8876-5307b70fb107 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:34.934910 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc5522-a790-4063-8876-5307b70fb107 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:34.935193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc5522-a790-4063-8876-5307b70fb107 None admin] PATH_INFO: `/v3/services` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:34.935907 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc5522-a790-4063-8876-5307b70fb107 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:34.936221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc5522-a790-4063-8876-5307b70fb107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:34.937623 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc5522-a790-4063-8876-5307b70fb107 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:34.941983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 467/913] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Jun 6 06:59:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 06:59:37.245702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbe350-0924-44b7-9b8d-a023d700524f None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:37.246245 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbe350-0924-44b7-9b8d-a023d700524f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:37.246245 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbe350-0924-44b7-9b8d-a023d700524f None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:37.247601 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 447/914] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:37.252928 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141211f-ce92-40c2-9a81-c3cb0d2524b2 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:37.253314 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141211f-ce92-40c2-9a81-c3cb0d2524b2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:37.253502 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141211f-ce92-40c2-9a81-c3cb0d2524b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:37.271341 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-b141211f-ce92-40c2-9a81-c3cb0d2524b2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:37.272532 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-b141211f-ce92-40c2-9a81-c3cb0d2524b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:37.299523 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:37.338481 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 468/915] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:37 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:37.363137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbe350-0924-44b7-9b8d-a023d700524f None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:37.394699 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:37.463848 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbe350-0924-44b7-9b8d-a023d700524f None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:37.496566 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380fee1-13ed-49a0-bf4e-d5176e3bdcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:37.497200 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380fee1-13ed-49a0-bf4e-d5176e3bdcf5 None admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:37.497484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380fee1-13ed-49a0-bf4e-d5176e3bdcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:37.497760 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380fee1-13ed-49a0-bf4e-d5176e3bdcf5 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:37.498529 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380fee1-13ed-49a0-bf4e-d5176e3bdcf5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:37.500406 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380fee1-13ed-49a0-bf4e-d5176e3bdcf5 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:37.595811 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 448/916] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Jun 6 06:59:37 2022] POST /identity/v3/services => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:59:39.957197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d551e2-2fbc-456c-9087-0da4f3ac8793 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:39.957698 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d551e2-2fbc-456c-9087-0da4f3ac8793 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:39.957799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d551e2-2fbc-456c-9087-0da4f3ac8793 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:39.959180 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 469/917] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:39.964527 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3233-e114-4d83-bf00-6ebbee62d087 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:39.964956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3233-e114-4d83-bf00-6ebbee62d087 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:39.965103 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3233-e114-4d83-bf00-6ebbee62d087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:39.982479 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-16bc3233-e114-4d83-bf00-6ebbee62d087 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:39.983694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-16bc3233-e114-4d83-bf00-6ebbee62d087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:40.056487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 449/918] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:39 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:40.080935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d551e2-2fbc-456c-9087-0da4f3ac8793 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:40.183273 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d551e2-2fbc-456c-9087-0da4f3ac8793 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:40.216312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae86233-4af3-4fc6-ace7-c972a2e19cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:40.217112 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae86233-4af3-4fc6-ace7-c972a2e19cc2 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:40.217391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae86233-4af3-4fc6-ace7-c972a2e19cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:40.217668 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae86233-4af3-4fc6-ace7-c972a2e19cc2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:40.218323 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae86233-4af3-4fc6-ace7-c972a2e19cc2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:40.219721 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae86233-4af3-4fc6-ace7-c972a2e19cc2 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-6ae86233-4af3-4fc6-ace7-c972a2e19cc2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:40.231402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:40.232578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:40.233443 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 470/919] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jun 6 06:59:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:40.239318 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc3233-e114-4d83-bf00-6ebbee62d087 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:40.258178 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:40.335460 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc3233-e114-4d83-bf00-6ebbee62d087 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:40.368796 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8af97e-d9e5-47ea-93c6-4ec8aa9bcd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:40.369456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8af97e-d9e5-47ea-93c6-4ec8aa9bcd76 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:40.371412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8af97e-d9e5-47ea-93c6-4ec8aa9bcd76 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:40.371412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8af97e-d9e5-47ea-93c6-4ec8aa9bcd76 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:40.371412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8af97e-d9e5-47ea-93c6-4ec8aa9bcd76 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:40.371412 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8af97e-d9e5-47ea-93c6-4ec8aa9bcd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:40.372381 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8af97e-d9e5-47ea-93c6-4ec8aa9bcd76 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:40.377966 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 450/920] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Jun 6 06:59:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:40.384201 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae86233-4af3-4fc6-ace7-c972a2e19cc2 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:40.412954 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:40.481791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae86233-4af3-4fc6-ace7-c972a2e19cc2 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:40.520172 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3588d82-1897-41f4-a32c-fe8aa518944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:40.521550 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3588d82-1897-41f4-a32c-fe8aa518944d None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:40.521963 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3588d82-1897-41f4-a32c-fe8aa518944d None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:40.522124 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3588d82-1897-41f4-a32c-fe8aa518944d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:40.522978 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3588d82-1897-41f4-a32c-fe8aa518944d None admin] RBAC: Adding query filter params (interface=public, service_id=e6ce071ba410441d934893e9370099a5, region_id=RegionOne) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:40.523293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3588d82-1897-41f4-a32c-fe8aa518944d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:40.524685 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3588d82-1897-41f4-a32c-fe8aa518944d None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:40.530209 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 471/921] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Jun 6 06:59:40 2022] GET /identity/v3/endpoints?service_id=e6ce071ba410441d934893e9370099a5&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:40.536619 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8af97e-d9e5-47ea-93c6-4ec8aa9bcd76 None admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:40.616803 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:40.634209 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8af97e-d9e5-47ea-93c6-4ec8aa9bcd76 None admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:40.667799 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ff179-ac38-40d3-a2b9-cc28d99e3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:40.668453 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ff179-ac38-40d3-a2b9-cc28d99e3470 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:40.669909 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ff179-ac38-40d3-a2b9-cc28d99e3470 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:40.669909 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ff179-ac38-40d3-a2b9-cc28d99e3470 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:40.669909 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ff179-ac38-40d3-a2b9-cc28d99e3470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:40.671109 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ff179-ac38-40d3-a2b9-cc28d99e3470 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:40.678173 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 451/922] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Jun 6 06:59:40 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 06:59:43.005107 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbe07-67cc-421a-84ae-8c894653e259 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:43.005660 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbe07-67cc-421a-84ae-8c894653e259 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:43.005660 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbe07-67cc-421a-84ae-8c894653e259 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:43.007388 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 472/923] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 06:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 06:59:43.012646 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0dd5-70d8-428b-8ed5-9b532c5b9f00 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:43.013039 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0dd5-70d8-428b-8ed5-9b532c5b9f00 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:43.013206 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0dd5-70d8-428b-8ed5-9b532c5b9f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:43.030048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-3c3c0dd5-70d8-428b-8ed5-9b532c5b9f00 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 06:59:43.031808 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-3c3c0dd5-70d8-428b-8ed5-9b532c5b9f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 06:59:43.098464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 452/924] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 06:59:43 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 06 06:59:43.123210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbe07-67cc-421a-84ae-8c894653e259 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:43.214592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:43.224366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbe07-67cc-421a-84ae-8c894653e259 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:43.257289 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85377471-df49-4a81-bd2b-1969a0132ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:43.258338 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377471-df49-4a81-bd2b-1969a0132ae7 None admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:43.258796 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377471-df49-4a81-bd2b-1969a0132ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:43.259129 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377471-df49-4a81-bd2b-1969a0132ae7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:43.260109 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377471-df49-4a81-bd2b-1969a0132ae7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:43.261505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377471-df49-4a81-bd2b-1969a0132ae7 None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application [None req-85377471-df49-4a81-bd2b-1969a0132ae7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 06 06:59:43.274210 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 06 06:59:43.276610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.get_or_create( Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application with Lock( Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self._enter() Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application return self.creator() Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application created_value = creator( Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: ERROR keystone.server.flask.application Jun 06 06:59:43.277634 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 473/925] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Jun 6 06:59:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 06 06:59:43.281705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c0dd5-70d8-428b-8ed5-9b532c5b9f00 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:43.374252 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:43.396961 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c0dd5-70d8-428b-8ed5-9b532c5b9f00 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:43.429557 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51b33-1286-4966-a4c4-ce2b35a60d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:43.430220 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51b33-1286-4966-a4c4-ce2b35a60d50 None admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:43.430543 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51b33-1286-4966-a4c4-ce2b35a60d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:43.430821 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51b33-1286-4966-a4c4-ce2b35a60d50 None admin] PATH_INFO: `/v3/services` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:43.431532 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51b33-1286-4966-a4c4-ce2b35a60d50 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 06:59:43.431842 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51b33-1286-4966-a4c4-ce2b35a60d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:43.433214 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51b33-1286-4966-a4c4-ce2b35a60d50 None admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:43.438350 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 453/926] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Jun 6 06:59:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 06:59:43.443937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85377471-df49-4a81-bd2b-1969a0132ae7 None admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 06:59:43.542324 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85377471-df49-4a81-bd2b-1969a0132ae7 None admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 06:59:43.575619 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce7c55-0c2d-4c53-9c78-1f9229717dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 06:59:43.576268 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7c55-0c2d-4c53-9c78-1f9229717dca None admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 06:59:43.579836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7c55-0c2d-4c53-9c78-1f9229717dca None admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 06:59:43.579836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7c55-0c2d-4c53-9c78-1f9229717dca None admin] PATH_INFO: `/v3/endpoints` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 06:59:43.579836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce7c55-0c2d-4c53-9c78-1f9229717dca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 06:59:43.579836 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce7c55-0c2d-4c53-9c78-1f9229717dca None admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 06:59:43.694421 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 474/927] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Jun 6 06:59:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 06:59:53.464382 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=30 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 06:59:53.689750 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:05:38.406622 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78239761-2804-4718-b25b-aad27a664b1c None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:38.407197 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78239761-2804-4718-b25b-aad27a664b1c None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:38.407197 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78239761-2804-4718-b25b-aad27a664b1c None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:38.409745 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 454/928] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:05:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:38.416408 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c278-1010-4510-ba4a-a9b61ee7fb18 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:38.416937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c278-1010-4510-ba4a-a9b61ee7fb18 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:38.417027 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c278-1010-4510-ba4a-a9b61ee7fb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:38.519026 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-8d32c278-1010-4510-ba4a-a9b61ee7fb18 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:38.520256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-8d32c278-1010-4510-ba4a-a9b61ee7fb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:38.679242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 475/929] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:05:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:05:38.730413 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091b066-e1f4-4e02-88b7-1aaea3a90873 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:38.731986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091b066-e1f4-4e02-88b7-1aaea3a90873 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:38.731986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091b066-e1f4-4e02-88b7-1aaea3a90873 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:38.732451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 455/930] 10.222.0.42 () {54 vars in 964 bytes} [Mon Jun 6 07:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:38.738885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eea48-0fb5-474b-aba4-e878de939755 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:38.739211 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eea48-0fb5-474b-aba4-e878de939755 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:38.739498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eea48-0fb5-474b-aba4-e878de939755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:38.799878 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-512eea48-0fb5-474b-aba4-e878de939755 None None] MFA Rules not processed for user `77904d1264284c29b2d0b73831dd4096`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:38.801491 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-512eea48-0fb5-474b-aba4-e878de939755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:38.883453 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:05:38.893198 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 476/931] 10.222.0.42 () {58 vars in 1061 bytes} [Mon Jun 6 07:05:38 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:05:38.903070 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091b066-e1f4-4e02-88b7-1aaea3a90873 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:05:38.914295 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091b066-e1f4-4e02-88b7-1aaea3a90873 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:05:38.917868 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6b0b-0e78-4225-95c7-2f8b84172777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:05:38.918570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6b0b-0e78-4225-95c7-2f8b84172777 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:38.918905 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6b0b-0e78-4225-95c7-2f8b84172777 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:38.919194 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6b0b-0e78-4225-95c7-2f8b84172777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:38.931088 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6b0b-0e78-4225-95c7-2f8b84172777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:05:38.934005 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6b0b-0e78-4225-95c7-2f8b84172777 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:05:38.942953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 456/932] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:05:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:05:41.531488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d958-9edb-447d-88f5-d22813364de8 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:41.532152 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d958-9edb-447d-88f5-d22813364de8 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:41.532152 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d958-9edb-447d-88f5-d22813364de8 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:41.533417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 477/933] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:41.539191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc90ce-0675-44c4-ae87-e66af7d79824 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:41.539625 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc90ce-0675-44c4-ae87-e66af7d79824 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:41.539845 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc90ce-0675-44c4-ae87-e66af7d79824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:41.557629 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-07bc90ce-0675-44c4-ae87-e66af7d79824 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:41.558876 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-07bc90ce-0675-44c4-ae87-e66af7d79824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:41.566845 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 457/934] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:05:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:05:41.625113 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6333f6-c766-4439-b5a2-cfeb20122e89 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:41.625403 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6333f6-c766-4439-b5a2-cfeb20122e89 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:41.625687 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6333f6-c766-4439-b5a2-cfeb20122e89 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:41.627097 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 478/935] 10.222.0.42 () {54 vars in 964 bytes} [Mon Jun 6 07:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:41.633000 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9109dd-3a3d-4f05-adab-f36bdd865300 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:41.633291 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9109dd-3a3d-4f05-adab-f36bdd865300 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:41.633572 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9109dd-3a3d-4f05-adab-f36bdd865300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:41.652277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-4d9109dd-3a3d-4f05-adab-f36bdd865300 None None] MFA Rules not processed for user `77904d1264284c29b2d0b73831dd4096`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:41.653463 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-4d9109dd-3a3d-4f05-adab-f36bdd865300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:41.659884 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 458/936] 10.222.0.42 () {58 vars in 1061 bytes} [Mon Jun 6 07:05:41 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:05:41.669239 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6333f6-c766-4439-b5a2-cfeb20122e89 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:05:41.679944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6333f6-c766-4439-b5a2-cfeb20122e89 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:05:41.683422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4550b51-9d1f-45c4-b68c-2698c26ccb48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:05:41.684057 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4550b51-9d1f-45c4-b68c-2698c26ccb48 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:41.684344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4550b51-9d1f-45c4-b68c-2698c26ccb48 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:41.684623 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4550b51-9d1f-45c4-b68c-2698c26ccb48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:41.693329 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4550b51-9d1f-45c4-b68c-2698c26ccb48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:05:41.695336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4550b51-9d1f-45c4-b68c-2698c26ccb48 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:05:41.704569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 479/937] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:05:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:05:44.743615 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c68c-4baa-4544-9d65-f21e45c583c1 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:44.744143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c68c-4baa-4544-9d65-f21e45c583c1 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:44.744250 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915c68c-4baa-4544-9d65-f21e45c583c1 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:44.745706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 459/938] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:44.750847 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bd972-935c-416d-9dbc-39491407c361 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:44.751267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bd972-935c-416d-9dbc-39491407c361 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:44.751441 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bd972-935c-416d-9dbc-39491407c361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:44.789197 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-402bd972-935c-416d-9dbc-39491407c361 None None] MFA Rules not processed for user `7840bfcb9b9443cc92e2e8f6e347f9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:44.790813 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-402bd972-935c-416d-9dbc-39491407c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:44.867418 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 480/939] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:05:44 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:05:44.908737 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915c68c-4baa-4544-9d65-f21e45c583c1 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:05:44.935025 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915c68c-4baa-4544-9d65-f21e45c583c1 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:05:44.938745 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4453b1-95d1-421c-97ec-5036da0fe28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:05:44.939425 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4453b1-95d1-421c-97ec-5036da0fe28d service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:44.939714 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4453b1-95d1-421c-97ec-5036da0fe28d service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:44.939994 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4453b1-95d1-421c-97ec-5036da0fe28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:44.951368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4453b1-95d1-421c-97ec-5036da0fe28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:05:44.952854 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4453b1-95d1-421c-97ec-5036da0fe28d service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:05:44.964475 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 460/940] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:05:44 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:05:48.137111 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79430f-2244-4c27-a5a4-7174c8b28340 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:48.137616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79430f-2244-4c27-a5a4-7174c8b28340 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:48.137616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79430f-2244-4c27-a5a4-7174c8b28340 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:48.138979 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 481/941] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:48.144437 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931c17-054f-4a79-a1ae-0735a5028199 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:48.144828 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931c17-054f-4a79-a1ae-0735a5028199 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:48.145123 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931c17-054f-4a79-a1ae-0735a5028199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:48.177458 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-38931c17-054f-4a79-a1ae-0735a5028199 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:48.179174 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-38931c17-054f-4a79-a1ae-0735a5028199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:48.260135 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 461/942] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:05:48 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:05:48.298981 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79430f-2244-4c27-a5a4-7174c8b28340 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:05:48.309942 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79430f-2244-4c27-a5a4-7174c8b28340 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:05:48.313402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265ffc1-c179-40a6-9d90-d8d6ca139607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:05:48.314037 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265ffc1-c179-40a6-9d90-d8d6ca139607 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:48.314326 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265ffc1-c179-40a6-9d90-d8d6ca139607 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:48.314641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265ffc1-c179-40a6-9d90-d8d6ca139607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:48.323981 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265ffc1-c179-40a6-9d90-d8d6ca139607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:05:48.325420 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265ffc1-c179-40a6-9d90-d8d6ca139607 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:05:48.334715 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 482/943] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:05:48 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:05:51.845665 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a43d5-227a-4745-806a-22a284df551d None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:51.846256 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a43d5-227a-4745-806a-22a284df551d None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:51.846256 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a43d5-227a-4745-806a-22a284df551d None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:51.847639 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 462/944] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:51.852852 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6939514-e35d-466e-9e8f-c0266ca719f2 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:51.853280 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6939514-e35d-466e-9e8f-c0266ca719f2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:51.853418 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6939514-e35d-466e-9e8f-c0266ca719f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:51.871380 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-d6939514-e35d-466e-9e8f-c0266ca719f2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:51.872575 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-d6939514-e35d-466e-9e8f-c0266ca719f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:51.880198 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 483/945] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:05:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:05:51.917069 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a43d5-227a-4745-806a-22a284df551d None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:05:51.927938 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a43d5-227a-4745-806a-22a284df551d None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:05:51.932078 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51855039-f27c-494d-b12a-b7e6fa88054b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:05:51.932795 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51855039-f27c-494d-b12a-b7e6fa88054b service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:51.933146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51855039-f27c-494d-b12a-b7e6fa88054b service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:51.933494 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51855039-f27c-494d-b12a-b7e6fa88054b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:51.943466 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51855039-f27c-494d-b12a-b7e6fa88054b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:05:51.945678 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51855039-f27c-494d-b12a-b7e6fa88054b service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:05:51.959919 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 463/946] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:05:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:05:54.322006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddd996-ce20-429a-a593-f8b259a8bf47 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:54.322575 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddd996-ce20-429a-a593-f8b259a8bf47 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:54.322667 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddd996-ce20-429a-a593-f8b259a8bf47 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:54.323967 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 484/947] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:54.329393 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc1060-892b-424f-92e8-ab80399bdbb6 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:54.329824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc1060-892b-424f-92e8-ab80399bdbb6 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:54.330101 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc1060-892b-424f-92e8-ab80399bdbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:54.347611 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-15dc1060-892b-424f-92e8-ab80399bdbb6 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:54.348821 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-15dc1060-892b-424f-92e8-ab80399bdbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:54.356533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 464/948] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:05:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:05:54.393516 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddd996-ce20-429a-a593-f8b259a8bf47 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:05:54.403984 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddd996-ce20-429a-a593-f8b259a8bf47 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:05:54.407425 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dfa3e-226b-40cb-8a30-ce371466a556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:05:54.408058 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dfa3e-226b-40cb-8a30-ce371466a556 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:54.408343 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dfa3e-226b-40cb-8a30-ce371466a556 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:54.408623 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dfa3e-226b-40cb-8a30-ce371466a556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:54.417339 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dfa3e-226b-40cb-8a30-ce371466a556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:05:54.418806 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dfa3e-226b-40cb-8a30-ce371466a556 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:05:54.428325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 485/949] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:05:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:05:56.813003 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226191a-0633-4b25-8e83-36f3753f898a None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:56.813533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226191a-0633-4b25-8e83-36f3753f898a None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:56.813533 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226191a-0633-4b25-8e83-36f3753f898a None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:56.814898 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 465/950] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:56.820006 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118c15-3320-40ad-9b75-78c81da1a2a6 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:56.820455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118c15-3320-40ad-9b75-78c81da1a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:56.820561 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118c15-3320-40ad-9b75-78c81da1a2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:56.849813 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-59118c15-3320-40ad-9b75-78c81da1a2a6 None None] MFA Rules not processed for user `7840bfcb9b9443cc92e2e8f6e347f9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:56.851538 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-59118c15-3320-40ad-9b75-78c81da1a2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:56.859236 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 486/951] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:05:56 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:05:56.897748 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226191a-0633-4b25-8e83-36f3753f898a None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:05:56.908827 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226191a-0633-4b25-8e83-36f3753f898a None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:05:56.912434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6cb5e-a22a-4a97-b6b4-10560dff823b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:05:56.914063 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6cb5e-a22a-4a97-b6b4-10560dff823b service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:56.914063 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6cb5e-a22a-4a97-b6b4-10560dff823b service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:56.914315 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6cb5e-a22a-4a97-b6b4-10560dff823b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:56.923954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6cb5e-a22a-4a97-b6b4-10560dff823b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:05:56.925402 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6cb5e-a22a-4a97-b6b4-10560dff823b service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:05:56.935778 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 466/952] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:05:56 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:05:59.643374 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7b37-2ab6-4d02-b840-333ea6b184bf None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:59.643886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7b37-2ab6-4d02-b840-333ea6b184bf None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:59.643886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7b37-2ab6-4d02-b840-333ea6b184bf None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:59.645206 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 487/953] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:05:59.650919 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016de24-6aaf-4614-9857-d8e8ff32d98d None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:59.651397 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016de24-6aaf-4614-9857-d8e8ff32d98d None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:59.651504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016de24-6aaf-4614-9857-d8e8ff32d98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:59.675667 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-5016de24-6aaf-4614-9857-d8e8ff32d98d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:05:59.676892 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-5016de24-6aaf-4614-9857-d8e8ff32d98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:05:59.685516 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 467/954] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:05:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:05:59.722589 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d7b37-2ab6-4d02-b840-333ea6b184bf None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:05:59.734444 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d7b37-2ab6-4d02-b840-333ea6b184bf None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:05:59.737862 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7e39e-dcc4-42f7-b546-8fa4a8979265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:05:59.738539 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7e39e-dcc4-42f7-b546-8fa4a8979265 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:05:59.738826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7e39e-dcc4-42f7-b546-8fa4a8979265 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:05:59.739106 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7e39e-dcc4-42f7-b546-8fa4a8979265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:05:59.748837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7e39e-dcc4-42f7-b546-8fa4a8979265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:05:59.750450 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7e39e-dcc4-42f7-b546-8fa4a8979265 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:05:59.760249 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 488/955] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:05:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:02.149263 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fd0d4-7cab-4b40-94a9-911244fdf894 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:02.149263 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fd0d4-7cab-4b40-94a9-911244fdf894 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:02.149943 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fd0d4-7cab-4b40-94a9-911244fdf894 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:02.150950 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 468/956] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:02.156056 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0811d08-d7ce-4988-a1e8-3437ace52201 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:02.156465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0811d08-d7ce-4988-a1e8-3437ace52201 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:02.156627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0811d08-d7ce-4988-a1e8-3437ace52201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:02.174965 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-d0811d08-d7ce-4988-a1e8-3437ace52201 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:02.176166 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-d0811d08-d7ce-4988-a1e8-3437ace52201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:02.184782 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 489/957] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:02.224932 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fd0d4-7cab-4b40-94a9-911244fdf894 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:02.236008 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fd0d4-7cab-4b40-94a9-911244fdf894 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:02.239488 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a2c90-a827-4774-82b2-62a81b881bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:02.240121 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a2c90-a827-4774-82b2-62a81b881bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:02.240411 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a2c90-a827-4774-82b2-62a81b881bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:02.240696 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a2c90-a827-4774-82b2-62a81b881bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:02.250043 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a2c90-a827-4774-82b2-62a81b881bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:02.251519 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a2c90-a827-4774-82b2-62a81b881bb4 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:02.262096 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 469/958] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:05.197312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978f45a-87fa-462b-a68b-c528f98e8dfa None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:05.197837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978f45a-87fa-462b-a68b-c528f98e8dfa None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:05.197837 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978f45a-87fa-462b-a68b-c528f98e8dfa None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:05.199183 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 490/959] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:05.204414 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe462cb4-15dd-4a7d-aaf6-276d333fc470 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:05.204855 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe462cb4-15dd-4a7d-aaf6-276d333fc470 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:05.204967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe462cb4-15dd-4a7d-aaf6-276d333fc470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:05.211605 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=85 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:06:05.223444 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-fe462cb4-15dd-4a7d-aaf6-276d333fc470 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:05.224648 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-fe462cb4-15dd-4a7d-aaf6-276d333fc470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:05.232399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 470/960] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:05 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:05.269382 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978f45a-87fa-462b-a68b-c528f98e8dfa None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:05.280672 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978f45a-87fa-462b-a68b-c528f98e8dfa None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:05.284193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2273d-1f99-437e-8aab-f7a7a34e1b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:05.284830 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2273d-1f99-437e-8aab-f7a7a34e1b15 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:05.285120 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2273d-1f99-437e-8aab-f7a7a34e1b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:05.285404 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2273d-1f99-437e-8aab-f7a7a34e1b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:05.294262 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2273d-1f99-437e-8aab-f7a7a34e1b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:05.295732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2273d-1f99-437e-8aab-f7a7a34e1b15 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:05.305080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 491/961] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:05 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:09.881112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043a4d-955f-4b3b-8277-f28a567eda6c None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:09.882179 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043a4d-955f-4b3b-8277-f28a567eda6c None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:09.882179 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043a4d-955f-4b3b-8277-f28a567eda6c None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:09.883601 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 471/962] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:09.888851 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ba058-8e16-4b36-bd14-fba8fd418883 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:09.889242 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ba058-8e16-4b36-bd14-fba8fd418883 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:09.889417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ba058-8e16-4b36-bd14-fba8fd418883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:09.895751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=87 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:06:09.910646 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-762ba058-8e16-4b36-bd14-fba8fd418883 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:09.910646 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-762ba058-8e16-4b36-bd14-fba8fd418883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:09.918047 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 492/963] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:09.958827 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043a4d-955f-4b3b-8277-f28a567eda6c None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:09.969688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043a4d-955f-4b3b-8277-f28a567eda6c None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:09.973222 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce48a5-927d-4970-8056-8d6bc6565cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:09.973854 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce48a5-927d-4970-8056-8d6bc6565cfc service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:09.974140 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce48a5-927d-4970-8056-8d6bc6565cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:09.974456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce48a5-927d-4970-8056-8d6bc6565cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:09.983451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce48a5-927d-4970-8056-8d6bc6565cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:09.984920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce48a5-927d-4970-8056-8d6bc6565cfc service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:09.994858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 472/964] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:13.254735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c34b3-bcff-4b14-a8eb-c15ab2dc963e None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:13.255292 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c34b3-bcff-4b14-a8eb-c15ab2dc963e None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:13.255292 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c34b3-bcff-4b14-a8eb-c15ab2dc963e None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:13.256592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 493/965] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:13.261707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997e497-8232-443b-89f5-337a60c2d403 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:13.262134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997e497-8232-443b-89f5-337a60c2d403 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:13.262276 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997e497-8232-443b-89f5-337a60c2d403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:13.280155 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-f997e497-8232-443b-89f5-337a60c2d403 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:13.281363 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-f997e497-8232-443b-89f5-337a60c2d403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:13.289892 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 473/966] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:13 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:13.328476 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c34b3-bcff-4b14-a8eb-c15ab2dc963e None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:13.339102 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c34b3-bcff-4b14-a8eb-c15ab2dc963e None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:13.342622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8fcf4-2441-4505-a70e-cc638a84fef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:13.343349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8fcf4-2441-4505-a70e-cc638a84fef6 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:13.343642 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8fcf4-2441-4505-a70e-cc638a84fef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:13.343924 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8fcf4-2441-4505-a70e-cc638a84fef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:13.353575 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8fcf4-2441-4505-a70e-cc638a84fef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:13.355066 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8fcf4-2441-4505-a70e-cc638a84fef6 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:13.373990 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 494/967] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:13 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:18.169235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5323114-2d04-4523-95f6-4eb4aeb1194b None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:18.169758 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5323114-2d04-4523-95f6-4eb4aeb1194b None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:18.169758 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5323114-2d04-4523-95f6-4eb4aeb1194b None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:18.171098 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 474/968] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:18.176248 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77e4c3-7000-41d7-8254-e50f28d03178 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:18.176645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77e4c3-7000-41d7-8254-e50f28d03178 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:18.176820 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77e4c3-7000-41d7-8254-e50f28d03178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:18.194310 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-1b77e4c3-7000-41d7-8254-e50f28d03178 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:18.195518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-1b77e4c3-7000-41d7-8254-e50f28d03178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:18.203217 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 495/969] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:18.242046 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5323114-2d04-4523-95f6-4eb4aeb1194b None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:18.252633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5323114-2d04-4523-95f6-4eb4aeb1194b None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:18.256161 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce09803-8e4a-4811-a9a2-e064ae589b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:18.256799 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce09803-8e4a-4811-a9a2-e064ae589b05 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:18.257089 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce09803-8e4a-4811-a9a2-e064ae589b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:18.257370 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce09803-8e4a-4811-a9a2-e064ae589b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:18.266258 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce09803-8e4a-4811-a9a2-e064ae589b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:18.267989 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce09803-8e4a-4811-a9a2-e064ae589b05 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:18.277837 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 475/970] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:23.744414 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca88c7-b1e5-4b16-8bf6-79aea443b105 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:23.745301 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca88c7-b1e5-4b16-8bf6-79aea443b105 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:23.745731 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca88c7-b1e5-4b16-8bf6-79aea443b105 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:23.747534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 496/971] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jun 6 07:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:23.752522 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8546e8-af71-45a8-82a1-0d6b8d6e81f7 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:23.752957 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8546e8-af71-45a8-82a1-0d6b8d6e81f7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:23.753283 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8546e8-af71-45a8-82a1-0d6b8d6e81f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:23.819071 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-2b8546e8-af71-45a8-82a1-0d6b8d6e81f7 None None] MFA Rules not processed for user `33b6268131ad4545a07647d41b864f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:23.821377 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-2b8546e8-af71-45a8-82a1-0d6b8d6e81f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:23.922145 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 476/972] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jun 6 07:06:23 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:28.189376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=11 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:06:28.303281 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e72a-7fa3-4cce-b62d-6e8bcf6a59bc None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:28.304151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e72a-7fa3-4cce-b62d-6e8bcf6a59bc None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:28.304404 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e72a-7fa3-4cce-b62d-6e8bcf6a59bc None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:28.305907 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 497/973] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jun 6 07:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:28.310744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4c9a-21a8-4667-8d3c-c36475d79df8 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:28.311210 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4c9a-21a8-4667-8d3c-c36475d79df8 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:28.311510 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4c9a-21a8-4667-8d3c-c36475d79df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:28.330861 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-9dfa4c9a-21a8-4667-8d3c-c36475d79df8 None None] MFA Rules not processed for user `33b6268131ad4545a07647d41b864f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:28.332218 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-9dfa4c9a-21a8-4667-8d3c-c36475d79df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:28.341980 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 477/974] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jun 6 07:06:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:30.030606 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421deaaa-a949-4f1e-a075-5e6f396f01c4 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:30.031128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421deaaa-a949-4f1e-a075-5e6f396f01c4 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:30.031128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421deaaa-a949-4f1e-a075-5e6f396f01c4 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:30.032559 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 498/975] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jun 6 07:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:30.037540 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3038-683d-4ed8-903e-aba89e580836 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:30.037973 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3038-683d-4ed8-903e-aba89e580836 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:30.038114 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3038-683d-4ed8-903e-aba89e580836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:30.056051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-220d3038-683d-4ed8-903e-aba89e580836 None None] MFA Rules not processed for user `33b6268131ad4545a07647d41b864f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:30.057226 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-220d3038-683d-4ed8-903e-aba89e580836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:30.065611 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 478/976] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jun 6 07:06:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:34.084237 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f854c-2e92-4f95-bcfe-a4d5c0ec0ad8 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:34.085272 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f854c-2e92-4f95-bcfe-a4d5c0ec0ad8 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:34.085394 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f854c-2e92-4f95-bcfe-a4d5c0ec0ad8 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:34.086960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 499/977] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:34.091915 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096cb45-c270-4060-b4e5-39b0221d6af1 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:34.092313 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096cb45-c270-4060-b4e5-39b0221d6af1 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:34.092489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096cb45-c270-4060-b4e5-39b0221d6af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:34.111411 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-6096cb45-c270-4060-b4e5-39b0221d6af1 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:34.112605 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-6096cb45-c270-4060-b4e5-39b0221d6af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:34.121283 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 479/978] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:06:34.176846 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612344c-60b2-4033-8a0a-a275e87721b7 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:34.177401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612344c-60b2-4033-8a0a-a275e87721b7 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:34.177902 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612344c-60b2-4033-8a0a-a275e87721b7 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:34.180009 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 500/979] 10.222.0.42 () {54 vars in 961 bytes} [Mon Jun 6 07:06:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:34.187461 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b652978-52bf-4820-92e1-f5ba842fad52 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:34.188002 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b652978-52bf-4820-92e1-f5ba842fad52 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:34.188507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b652978-52bf-4820-92e1-f5ba842fad52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:34.227764 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-8b652978-52bf-4820-92e1-f5ba842fad52 None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:34.229055 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-8b652978-52bf-4820-92e1-f5ba842fad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:34.280109 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:06:34.312316 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 480/980] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Jun 6 07:06:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:34.320832 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612344c-60b2-4033-8a0a-a275e87721b7 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:34.338559 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612344c-60b2-4033-8a0a-a275e87721b7 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:34.343715 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63437b-f46c-465a-a151-48f1cf5d3f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:34.344764 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63437b-f46c-465a-a151-48f1cf5d3f14 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:34.345121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63437b-f46c-465a-a151-48f1cf5d3f14 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:34.345471 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63437b-f46c-465a-a151-48f1cf5d3f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:34.354480 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63437b-f46c-465a-a151-48f1cf5d3f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:34.357134 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63437b-f46c-465a-a151-48f1cf5d3f14 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:34.366926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 501/981] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:36.909578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceebee4-a3f8-4d3a-8fae-be86dbdae688 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:36.910508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceebee4-a3f8-4d3a-8fae-be86dbdae688 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:36.910963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceebee4-a3f8-4d3a-8fae-be86dbdae688 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:36.912586 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 481/982] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:36.918185 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77babc51-4c8b-40d3-ad37-f11cec3bba6b None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:36.918584 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77babc51-4c8b-40d3-ad37-f11cec3bba6b None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:36.918857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77babc51-4c8b-40d3-ad37-f11cec3bba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:36.944540 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-77babc51-4c8b-40d3-ad37-f11cec3bba6b None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:36.945769 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-77babc51-4c8b-40d3-ad37-f11cec3bba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:36.953888 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 502/983] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:37.014779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceebee4-a3f8-4d3a-8fae-be86dbdae688 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:37.033007 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceebee4-a3f8-4d3a-8fae-be86dbdae688 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:37.039523 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b873fe-c909-4589-9b2d-d97e084d2f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:37.040461 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b873fe-c909-4589-9b2d-d97e084d2f65 service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:37.040891 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b873fe-c909-4589-9b2d-d97e084d2f65 service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:37.041313 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b873fe-c909-4589-9b2d-d97e084d2f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:37.051767 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b873fe-c909-4589-9b2d-d97e084d2f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:37.053395 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b873fe-c909-4589-9b2d-d97e084d2f65 service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:37.063756 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 482/984] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:39.954483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9494b-08a3-4f15-a393-26808393649c None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:39.955129 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9494b-08a3-4f15-a393-26808393649c None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:39.955129 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9494b-08a3-4f15-a393-26808393649c None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:39.956464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 503/985] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:39.961730 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361ca8-8721-49a2-b3ab-aa102d83c81e None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:39.962129 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361ca8-8721-49a2-b3ab-aa102d83c81e None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:39.962291 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361ca8-8721-49a2-b3ab-aa102d83c81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:39.980223 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-4c361ca8-8721-49a2-b3ab-aa102d83c81e None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:39.981432 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-4c361ca8-8721-49a2-b3ab-aa102d83c81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:39.998368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 483/986] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:40.042941 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a205be-7056-46b6-8d98-23e856887455 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:40.043228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a205be-7056-46b6-8d98-23e856887455 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:40.043670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a205be-7056-46b6-8d98-23e856887455 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:40.045187 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 504/987] 10.222.0.42 () {54 vars in 961 bytes} [Mon Jun 6 07:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:40.050086 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f95d7b-f739-4e63-8241-a0c664510f42 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:40.050410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f95d7b-f739-4e63-8241-a0c664510f42 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:40.050748 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f95d7b-f739-4e63-8241-a0c664510f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:40.070158 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-89f95d7b-f739-4e63-8241-a0c664510f42 None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:40.071377 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-89f95d7b-f739-4e63-8241-a0c664510f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:40.080070 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 484/988] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Jun 6 07:06:40 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:06:40.090839 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a205be-7056-46b6-8d98-23e856887455 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:40.104136 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a205be-7056-46b6-8d98-23e856887455 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:40.109430 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da27c4-09e5-4b8b-888d-596d39eec3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:40.110435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da27c4-09e5-4b8b-888d-596d39eec3f5 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:40.110435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da27c4-09e5-4b8b-888d-596d39eec3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:40.110611 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da27c4-09e5-4b8b-888d-596d39eec3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:40.124160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da27c4-09e5-4b8b-888d-596d39eec3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:40.126344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da27c4-09e5-4b8b-888d-596d39eec3f5 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:40.148253 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 505/989] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:42.730972 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988ce3d-6df1-4053-9a23-53b16a87dd80 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:42.732055 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988ce3d-6df1-4053-9a23-53b16a87dd80 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:42.732581 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988ce3d-6df1-4053-9a23-53b16a87dd80 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:42.739686 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b44fe-a640-40ba-8806-c6c5027f2794 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:42.740563 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b44fe-a640-40ba-8806-c6c5027f2794 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:42.741612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b44fe-a640-40ba-8806-c6c5027f2794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:42.743839 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 485/990] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:42.760484 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-0c7b44fe-a640-40ba-8806-c6c5027f2794 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:42.761959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-0c7b44fe-a640-40ba-8806-c6c5027f2794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:42.782824 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 506/991] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:42.821287 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988ce3d-6df1-4053-9a23-53b16a87dd80 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:42.836683 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988ce3d-6df1-4053-9a23-53b16a87dd80 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:42.842583 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4054b2-a335-4961-9492-a1608e0b5f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:42.853353 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4054b2-a335-4961-9492-a1608e0b5f34 service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:42.853353 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4054b2-a335-4961-9492-a1608e0b5f34 service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:42.853353 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4054b2-a335-4961-9492-a1608e0b5f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:42.853353 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4054b2-a335-4961-9492-a1608e0b5f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:42.855304 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4054b2-a335-4961-9492-a1608e0b5f34 service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:42.878109 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 486/992] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:44.323831 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aa14f-8658-4175-a026-ff9ad8a455d6 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:44.324275 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aa14f-8658-4175-a026-ff9ad8a455d6 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:44.324568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aa14f-8658-4175-a026-ff9ad8a455d6 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:44.325898 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 507/993] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:44.341757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597787b5-325f-4722-95c4-ae07c7f62d68 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:44.341757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597787b5-325f-4722-95c4-ae07c7f62d68 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:44.341757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597787b5-325f-4722-95c4-ae07c7f62d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:44.373800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-597787b5-325f-4722-95c4-ae07c7f62d68 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:44.375441 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-597787b5-325f-4722-95c4-ae07c7f62d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:44.393116 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 487/994] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:44.705034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef8a9d-8b2b-41f0-8524-a7b62e7e1862 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:44.705034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef8a9d-8b2b-41f0-8524-a7b62e7e1862 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:44.705034 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef8a9d-8b2b-41f0-8524-a7b62e7e1862 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:44.707965 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 508/995] 10.222.0.42 () {54 vars in 963 bytes} [Mon Jun 6 07:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:44.713905 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0eee-4a49-437f-af23-3a104d6c3bd1 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:44.713905 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0eee-4a49-437f-af23-3a104d6c3bd1 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:44.713905 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0eee-4a49-437f-af23-3a104d6c3bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:44.749958 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-661f0eee-4a49-437f-af23-3a104d6c3bd1 None None] MFA Rules not processed for user `1c3429d0ba28474698c6c168270d314b`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:44.751210 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-661f0eee-4a49-437f-af23-3a104d6c3bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:44.825562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 488/996] 10.222.0.42 () {58 vars in 1060 bytes} [Mon Jun 6 07:06:44 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:44.832716 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef8a9d-8b2b-41f0-8524-a7b62e7e1862 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:44.843365 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef8a9d-8b2b-41f0-8524-a7b62e7e1862 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:44.846841 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43c3bf-e43f-4157-b3e6-1c8cb8cf5402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3429d0ba28474698c6c168270d314b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:44.847484 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c3bf-e43f-4157-b3e6-1c8cb8cf5402 service cinder] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:44.847773 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c3bf-e43f-4157-b3e6-1c8cb8cf5402 service cinder] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:44.848055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c3bf-e43f-4157-b3e6-1c8cb8cf5402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:44.857772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43c3bf-e43f-4157-b3e6-1c8cb8cf5402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:44.859241 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43c3bf-e43f-4157-b3e6-1c8cb8cf5402 service cinder] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:44.869411 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 509/997] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:45.528881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44872ee-f86f-4322-80c8-4a7c62a1f01e None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:45.533790 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44872ee-f86f-4322-80c8-4a7c62a1f01e None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:45.533790 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44872ee-f86f-4322-80c8-4a7c62a1f01e None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:45.535247 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 489/998] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:45.536801 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeccad6-bd18-467b-8340-4bad3198c9b5 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:45.537338 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeccad6-bd18-467b-8340-4bad3198c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:45.538325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeccad6-bd18-467b-8340-4bad3198c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:45.569949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-bfeccad6-bd18-467b-8340-4bad3198c9b5 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:45.571491 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-bfeccad6-bd18-467b-8340-4bad3198c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:45.580822 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 510/999] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:45.630985 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44872ee-f86f-4322-80c8-4a7c62a1f01e None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:45.648770 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44872ee-f86f-4322-80c8-4a7c62a1f01e None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:45.654457 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a83e2-76aa-485e-9feb-76e6db85a5d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:45.655126 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a83e2-76aa-485e-9feb-76e6db85a5d9 service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:45.655411 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a83e2-76aa-485e-9feb-76e6db85a5d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:45.655867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a83e2-76aa-485e-9feb-76e6db85a5d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:45.668438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a83e2-76aa-485e-9feb-76e6db85a5d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:45.670309 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a83e2-76aa-485e-9feb-76e6db85a5d9 service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:45.682829 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 490/1000] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:48.355355 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250d918-7d89-46e8-bf83-275875a6f4bd None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:48.355871 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250d918-7d89-46e8-bf83-275875a6f4bd None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:48.355976 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250d918-7d89-46e8-bf83-275875a6f4bd None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:48.357296 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 511/1001] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:48.364173 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee9ee-20fd-4bb3-bc0d-31a96cf4f4e4 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:48.364606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee9ee-20fd-4bb3-bc0d-31a96cf4f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:48.364754 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee9ee-20fd-4bb3-bc0d-31a96cf4f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:48.394800 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-ac8ee9ee-20fd-4bb3-bc0d-31a96cf4f4e4 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:48.396100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-ac8ee9ee-20fd-4bb3-bc0d-31a96cf4f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:48.404590 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 491/1002] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:48.450689 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250d918-7d89-46e8-bf83-275875a6f4bd None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:48.464216 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250d918-7d89-46e8-bf83-275875a6f4bd None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:48.469111 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf496-d5c1-4e89-9233-073c477969fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:48.469791 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf496-d5c1-4e89-9233-073c477969fb service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:48.470077 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf496-d5c1-4e89-9233-073c477969fb service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:48.470382 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf496-d5c1-4e89-9233-073c477969fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:48.479422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf496-d5c1-4e89-9233-073c477969fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:48.481013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf496-d5c1-4e89-9233-073c477969fb service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:48.490395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 512/1003] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:50.972617 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de219b6-71cc-41db-963a-9c2121ea44ca None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:50.973166 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de219b6-71cc-41db-963a-9c2121ea44ca None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:50.973166 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de219b6-71cc-41db-963a-9c2121ea44ca None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:50.977453 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 492/1004] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:50.980360 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d021c4-b300-4f35-83b2-bcfe636114b1 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:50.980758 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d021c4-b300-4f35-83b2-bcfe636114b1 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:50.980937 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d021c4-b300-4f35-83b2-bcfe636114b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:51.000735 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-50d021c4-b300-4f35-83b2-bcfe636114b1 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:51.002082 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-50d021c4-b300-4f35-83b2-bcfe636114b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:51.010371 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 513/1005] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:51.055166 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de219b6-71cc-41db-963a-9c2121ea44ca None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:51.069358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de219b6-71cc-41db-963a-9c2121ea44ca None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:51.074207 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e39708-9680-4b02-8a14-814ca067c4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:51.074889 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39708-9680-4b02-8a14-814ca067c4b3 service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:51.075179 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39708-9680-4b02-8a14-814ca067c4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:51.075457 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39708-9680-4b02-8a14-814ca067c4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:51.084796 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e39708-9680-4b02-8a14-814ca067c4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:51.086421 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e39708-9680-4b02-8a14-814ca067c4b3 service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:51.096561 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 493/1006] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:53.430711 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d75e2-1731-4588-ae0e-ba671cce1a47 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:53.431228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d75e2-1731-4588-ae0e-ba671cce1a47 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:53.431367 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d75e2-1731-4588-ae0e-ba671cce1a47 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:53.433080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 514/1007] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:53.440152 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5f82-da05-4f96-ba3e-7e2855af8c98 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:53.440579 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5f82-da05-4f96-ba3e-7e2855af8c98 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:53.440917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce5f82-da05-4f96-ba3e-7e2855af8c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:53.465151 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-62ce5f82-da05-4f96-ba3e-7e2855af8c98 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:53.466881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-62ce5f82-da05-4f96-ba3e-7e2855af8c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:53.477831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 494/1008] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:53.534589 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d75e2-1731-4588-ae0e-ba671cce1a47 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:53.549154 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d75e2-1731-4588-ae0e-ba671cce1a47 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:53.555130 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5d4e3-88fc-4fa1-9809-3b8036d12223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:53.555802 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5d4e3-88fc-4fa1-9809-3b8036d12223 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:53.556125 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5d4e3-88fc-4fa1-9809-3b8036d12223 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:53.556396 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5d4e3-88fc-4fa1-9809-3b8036d12223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:53.566842 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5d4e3-88fc-4fa1-9809-3b8036d12223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:53.569796 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5d4e3-88fc-4fa1-9809-3b8036d12223 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:53.583349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 515/1009] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:56.374434 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b150d2c-996b-4835-822b-fde77c3d531e None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:56.375060 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b150d2c-996b-4835-822b-fde77c3d531e None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:56.375060 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b150d2c-996b-4835-822b-fde77c3d531e None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:56.376389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 495/1010] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:06:56.382353 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3615f-cedc-456b-a9f7-8172c81657ee None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:56.382824 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3615f-cedc-456b-a9f7-8172c81657ee None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:56.382924 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3615f-cedc-456b-a9f7-8172c81657ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:56.401658 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-2ba3615f-cedc-456b-a9f7-8172c81657ee None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:06:56.402909 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-2ba3615f-cedc-456b-a9f7-8172c81657ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:06:56.410873 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 516/1011] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:06:56.461802 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b150d2c-996b-4835-822b-fde77c3d531e None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:06:56.478530 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b150d2c-996b-4835-822b-fde77c3d531e None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:06:56.484318 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2c77f-553d-41cc-a597-eefd6acf618e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:06:56.485005 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2c77f-553d-41cc-a597-eefd6acf618e service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:56.485297 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2c77f-553d-41cc-a597-eefd6acf618e service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:56.485582 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2c77f-553d-41cc-a597-eefd6acf618e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:56.495880 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2c77f-553d-41cc-a597-eefd6acf618e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:06:56.497790 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2c77f-553d-41cc-a597-eefd6acf618e service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:06:56.508827 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 496/1012] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:06:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:06:59.994095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68a7c-26c6-41b8-9a64-7e2798a67957 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:06:59.994753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68a7c-26c6-41b8-9a64-7e2798a67957 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:06:59.994753 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68a7c-26c6-41b8-9a64-7e2798a67957 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:06:59.996049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 517/1013] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:00.001471 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3140c76-79f4-4ca8-a616-57f7200d5436 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:00.001969 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3140c76-79f4-4ca8-a616-57f7200d5436 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:00.002081 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3140c76-79f4-4ca8-a616-57f7200d5436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:00.028456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-e3140c76-79f4-4ca8-a616-57f7200d5436 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:00.029670 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-e3140c76-79f4-4ca8-a616-57f7200d5436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:00.038085 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 497/1014] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:06:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:00.083380 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd68a7c-26c6-41b8-9a64-7e2798a67957 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:00.091438 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=46 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:07:00.097631 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd68a7c-26c6-41b8-9a64-7e2798a67957 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:00.103367 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc8634-0146-40db-b6e5-1a2ea7597b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:00.104045 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8634-0146-40db-b6e5-1a2ea7597b76 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:00.104328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8634-0146-40db-b6e5-1a2ea7597b76 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:00.104602 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc8634-0146-40db-b6e5-1a2ea7597b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:00.112921 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc8634-0146-40db-b6e5-1a2ea7597b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:00.114534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc8634-0146-40db-b6e5-1a2ea7597b76 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:00.124805 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 518/1015] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 07:07:01.356919 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dddcc-9038-4f43-bffa-8dcdbcbae41a None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:01.357543 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dddcc-9038-4f43-bffa-8dcdbcbae41a None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:01.357543 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dddcc-9038-4f43-bffa-8dcdbcbae41a None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:01.358982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 498/1016] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:01.364906 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347e92f-7c12-40c8-82c8-69dd28b3c84d None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:01.366379 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347e92f-7c12-40c8-82c8-69dd28b3c84d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:01.366670 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347e92f-7c12-40c8-82c8-69dd28b3c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:01.384605 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-7347e92f-7c12-40c8-82c8-69dd28b3c84d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:01.385796 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-7347e92f-7c12-40c8-82c8-69dd28b3c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:01.393918 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 519/1017] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:07:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:01.452276 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847aefa-a6a0-4f25-bc13-0ec22f57c5ef None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:01.452921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847aefa-a6a0-4f25-bc13-0ec22f57c5ef None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:01.452921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847aefa-a6a0-4f25-bc13-0ec22f57c5ef None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:01.454286 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 499/1018] 10.222.0.42 () {54 vars in 962 bytes} [Mon Jun 6 07:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:01.459505 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2af3ee-8206-402e-ac30-6c6befbd190a None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:01.464081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2af3ee-8206-402e-ac30-6c6befbd190a None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:01.464081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2af3ee-8206-402e-ac30-6c6befbd190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:01.497376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-cf2af3ee-8206-402e-ac30-6c6befbd190a None None] MFA Rules not processed for user `b1618d2efb0c45f98a081126f5342abc`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:01.498754 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-cf2af3ee-8206-402e-ac30-6c6befbd190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:01.560190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 520/1019] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Jun 6 07:07:01 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:07:01.567573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847aefa-a6a0-4f25-bc13-0ec22f57c5ef None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:01.578015 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847aefa-a6a0-4f25-bc13-0ec22f57c5ef None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:01.581511 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2542fa1-ee87-4521-97a4-ef855476ffbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1618d2efb0c45f98a081126f5342abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:01.582144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542fa1-ee87-4521-97a4-ef855476ffbc service glance] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:01.582461 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542fa1-ee87-4521-97a4-ef855476ffbc service glance] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:01.582743 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542fa1-ee87-4521-97a4-ef855476ffbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:01.591971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2542fa1-ee87-4521-97a4-ef855476ffbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:01.593390 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2542fa1-ee87-4521-97a4-ef855476ffbc service glance] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:01.603150 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 500/1020] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:02.569320 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bd136-5cfd-408e-9fb7-ef49f9b47385 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:02.569932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bd136-5cfd-408e-9fb7-ef49f9b47385 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:02.569932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bd136-5cfd-408e-9fb7-ef49f9b47385 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:02.571300 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 521/1021] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:02.576702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe82b7-72c9-488e-bae3-1105402cc55e None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:02.577228 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe82b7-72c9-488e-bae3-1105402cc55e None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:02.577334 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe82b7-72c9-488e-bae3-1105402cc55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:02.583430 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=100 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:07:02.597097 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-2ffe82b7-72c9-488e-bae3-1105402cc55e None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:02.598322 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-2ffe82b7-72c9-488e-bae3-1105402cc55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:02.607386 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 501/1022] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:07:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:02.652081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bd136-5cfd-408e-9fb7-ef49f9b47385 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:02.666719 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bd136-5cfd-408e-9fb7-ef49f9b47385 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:02.674855 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ba3cf-11e6-442b-a5ef-661c1eb107a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:02.674855 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba3cf-11e6-442b-a5ef-661c1eb107a1 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:02.674855 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba3cf-11e6-442b-a5ef-661c1eb107a1 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:02.674855 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba3cf-11e6-442b-a5ef-661c1eb107a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:02.681744 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ba3cf-11e6-442b-a5ef-661c1eb107a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:02.683379 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ba3cf-11e6-442b-a5ef-661c1eb107a1 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:02.692916 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 522/1023] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:05.249150 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aa715-79ed-4f5d-9d21-3ad10570bc94 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:05.249742 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aa715-79ed-4f5d-9d21-3ad10570bc94 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:05.249742 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aa715-79ed-4f5d-9d21-3ad10570bc94 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:05.251207 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 502/1024] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:05.256693 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978fc81-76dd-4e66-b4b7-cc599a627227 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:05.257209 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978fc81-76dd-4e66-b4b7-cc599a627227 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:05.257304 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978fc81-76dd-4e66-b4b7-cc599a627227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:05.276495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-c978fc81-76dd-4e66-b4b7-cc599a627227 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:05.278274 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-c978fc81-76dd-4e66-b4b7-cc599a627227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:05.286115 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 523/1025] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:07:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:05.331367 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aa715-79ed-4f5d-9d21-3ad10570bc94 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:05.347882 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aa715-79ed-4f5d-9d21-3ad10570bc94 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:05.353393 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0977b9-bbe7-4163-88dc-95da3e1d2467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:05.354073 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0977b9-bbe7-4163-88dc-95da3e1d2467 service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:05.354391 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0977b9-bbe7-4163-88dc-95da3e1d2467 service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:05.354676 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0977b9-bbe7-4163-88dc-95da3e1d2467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:05.363762 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0977b9-bbe7-4163-88dc-95da3e1d2467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:05.365951 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0977b9-bbe7-4163-88dc-95da3e1d2467 service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:05.376104 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 503/1026] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:15.273385 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=50 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:07:15.371678 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=8 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:07:17.582282 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ad1c6-f7f6-4cab-8766-8f5417ed029d None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:17.582915 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ad1c6-f7f6-4cab-8766-8f5417ed029d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:17.582915 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ad1c6-f7f6-4cab-8766-8f5417ed029d None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:17.584286 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 524/1027] 10.222.0.42 () {54 vars in 918 bytes} [Mon Jun 6 07:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:17.589960 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62e002-5870-4725-9083-fbfca0d0ec20 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:17.590431 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62e002-5870-4725-9083-fbfca0d0ec20 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:17.590565 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62e002-5870-4725-9083-fbfca0d0ec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:17.608820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-4a62e002-5870-4725-9083-fbfca0d0ec20 None None] MFA Rules not processed for user `33b6268131ad4545a07647d41b864f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:17.610038 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-4a62e002-5870-4725-9083-fbfca0d0ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:17.618487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 504/1028] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Jun 6 07:07:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:17.632147 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0958-ae28-4809-a1b5-03924b3003c7 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:17.632439 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0958-ae28-4809-a1b5-03924b3003c7 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:17.632722 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0958-ae28-4809-a1b5-03924b3003c7 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:17.634087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 525/1029] 10.222.0.42 () {54 vars in 918 bytes} [Mon Jun 6 07:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:17.638516 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1318e0-3610-468f-af94-bb014b779109 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:17.638813 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1318e0-3610-468f-af94-bb014b779109 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:17.639100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1318e0-3610-468f-af94-bb014b779109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:17.669296 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-bb1318e0-3610-468f-af94-bb014b779109 None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:17.670522 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-bb1318e0-3610-468f-af94-bb014b779109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:17.679449 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 505/1030] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Jun 6 07:07:17 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:20.424300 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57c355-73ab-437d-a188-ed3128c28ddf None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:20.424869 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57c355-73ab-437d-a188-ed3128c28ddf None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:20.424869 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57c355-73ab-437d-a188-ed3128c28ddf None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:20.426265 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 526/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:20.431670 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6401b0-3623-4432-b13e-c4134858a5cd None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:20.432063 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6401b0-3623-4432-b13e-c4134858a5cd None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:20.432247 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6401b0-3623-4432-b13e-c4134858a5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:20.449887 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-bf6401b0-3623-4432-b13e-c4134858a5cd None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:20.451108 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-bf6401b0-3623-4432-b13e-c4134858a5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:20.458792 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 506/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:20.506193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57c355-73ab-437d-a188-ed3128c28ddf None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:20.520340 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57c355-73ab-437d-a188-ed3128c28ddf None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:20.525330 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2eaf5-98ce-4e15-ab0a-562bf9fd37bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:20.525969 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2eaf5-98ce-4e15-ab0a-562bf9fd37bd service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:20.526257 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2eaf5-98ce-4e15-ab0a-562bf9fd37bd service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:20.526571 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2eaf5-98ce-4e15-ab0a-562bf9fd37bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:20.534720 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2eaf5-98ce-4e15-ab0a-562bf9fd37bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:20.536312 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2eaf5-98ce-4e15-ab0a-562bf9fd37bd service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:20.545626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 527/1033] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:21.551306 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb69e5-0919-4ccb-96b5-6a3516e078a4 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:21.551881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb69e5-0919-4ccb-96b5-6a3516e078a4 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:21.551881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb69e5-0919-4ccb-96b5-6a3516e078a4 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:21.553244 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 507/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:21.558654 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7cf9d-7670-4baf-bcf9-411040991488 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:21.559102 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7cf9d-7670-4baf-bcf9-411040991488 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:21.559201 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7cf9d-7670-4baf-bcf9-411040991488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:21.576888 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-6be7cf9d-7670-4baf-bcf9-411040991488 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:21.578079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-6be7cf9d-7670-4baf-bcf9-411040991488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:21.585799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 528/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:07:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:21.770999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb69e5-0919-4ccb-96b5-6a3516e078a4 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:21.784707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb69e5-0919-4ccb-96b5-6a3516e078a4 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:21.789563 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc3fe-ee7b-44f3-857a-c8f693abcc0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:21.790196 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc3fe-ee7b-44f3-857a-c8f693abcc0c service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:21.790522 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc3fe-ee7b-44f3-857a-c8f693abcc0c service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:21.790808 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc3fe-ee7b-44f3-857a-c8f693abcc0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:21.798821 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bc3fe-ee7b-44f3-857a-c8f693abcc0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:21.800410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bc3fe-ee7b-44f3-857a-c8f693abcc0c service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:21.810390 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 508/1036] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:22.750023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d7b3-2fb8-4e35-b807-aaa7500a1f34 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:22.750626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d7b3-2fb8-4e35-b807-aaa7500a1f34 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:22.750626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d7b3-2fb8-4e35-b807-aaa7500a1f34 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:22.752025 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 529/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:22.757079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758755b-1b39-453e-9d8a-2fed8c994d05 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:22.757524 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758755b-1b39-453e-9d8a-2fed8c994d05 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:22.757646 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758755b-1b39-453e-9d8a-2fed8c994d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:22.775936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-e758755b-1b39-453e-9d8a-2fed8c994d05 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:22.777129 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-e758755b-1b39-453e-9d8a-2fed8c994d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:22.784960 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 509/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:07:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:22.935483 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36d7b3-2fb8-4e35-b807-aaa7500a1f34 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:22.949299 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36d7b3-2fb8-4e35-b807-aaa7500a1f34 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:22.954202 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9a03c-7baa-4a03-a00f-8ee3d11cad95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:22.954886 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a03c-7baa-4a03-a00f-8ee3d11cad95 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:22.955170 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a03c-7baa-4a03-a00f-8ee3d11cad95 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:22.955448 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a03c-7baa-4a03-a00f-8ee3d11cad95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:22.963971 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9a03c-7baa-4a03-a00f-8ee3d11cad95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:22.965543 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9a03c-7baa-4a03-a00f-8ee3d11cad95 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:22.974852 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 530/1039] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:23.882112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d7bc6-769d-4163-9f0d-c37ad7419680 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:23.882915 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d7bc6-769d-4163-9f0d-c37ad7419680 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:23.882915 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d7bc6-769d-4163-9f0d-c37ad7419680 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:23.884575 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 510/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:23.889401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c63bb-85c6-4bf7-9ac4-2d717050fec0 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:23.889858 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c63bb-85c6-4bf7-9ac4-2d717050fec0 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:23.890007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c63bb-85c6-4bf7-9ac4-2d717050fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:23.907931 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-404c63bb-85c6-4bf7-9ac4-2d717050fec0 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:23.909149 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-404c63bb-85c6-4bf7-9ac4-2d717050fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:23.917635 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 531/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:07:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:24.070656 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d7bc6-769d-4163-9f0d-c37ad7419680 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:24.084333 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d7bc6-769d-4163-9f0d-c37ad7419680 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:24.089837 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9649c0-509a-416a-9e14-3236529382fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:24.090507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9649c0-509a-416a-9e14-3236529382fb service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:24.090797 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9649c0-509a-416a-9e14-3236529382fb service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:24.091073 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9649c0-509a-416a-9e14-3236529382fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:24.099335 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9649c0-509a-416a-9e14-3236529382fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:24.101578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9649c0-509a-416a-9e14-3236529382fb service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:24.110971 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 511/1042] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:25.023433 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a277861-1326-42ee-9c06-0ef50bbcd2e9 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:25.024054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a277861-1326-42ee-9c06-0ef50bbcd2e9 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:25.024316 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a277861-1326-42ee-9c06-0ef50bbcd2e9 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:25.026023 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 532/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:25.031206 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf370181-e8f8-49f4-9d40-261b9436dbda None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:25.031650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf370181-e8f8-49f4-9d40-261b9436dbda None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:25.031754 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf370181-e8f8-49f4-9d40-261b9436dbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:25.049939 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-bf370181-e8f8-49f4-9d40-261b9436dbda None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:25.051165 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-bf370181-e8f8-49f4-9d40-261b9436dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:25.058875 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 512/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:07:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:25.211987 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a277861-1326-42ee-9c06-0ef50bbcd2e9 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:25.225227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a277861-1326-42ee-9c06-0ef50bbcd2e9 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:25.230137 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f15c6e-e44c-4506-b1f0-170d4b2ab20a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:25.230811 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15c6e-e44c-4506-b1f0-170d4b2ab20a service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:25.231103 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15c6e-e44c-4506-b1f0-170d4b2ab20a service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:25.231382 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15c6e-e44c-4506-b1f0-170d4b2ab20a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:25.239495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f15c6e-e44c-4506-b1f0-170d4b2ab20a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:25.241158 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f15c6e-e44c-4506-b1f0-170d4b2ab20a service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:25.250762 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 533/1045] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:26.154160 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df867e-5fc4-4682-ab47-f1df2d4c9f3b None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:26.154773 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df867e-5fc4-4682-ab47-f1df2d4c9f3b None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:26.154773 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df867e-5fc4-4682-ab47-f1df2d4c9f3b None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:26.156204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 513/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:26.161180 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b1c4f-f7d6-4951-bbb5-328b9d0d1d18 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:26.161649 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b1c4f-f7d6-4951-bbb5-328b9d0d1d18 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:26.161748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b1c4f-f7d6-4951-bbb5-328b9d0d1d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:26.179585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-730b1c4f-f7d6-4951-bbb5-328b9d0d1d18 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:26.180710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-730b1c4f-f7d6-4951-bbb5-328b9d0d1d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:26.188439 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 534/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:07:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:26.339735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df867e-5fc4-4682-ab47-f1df2d4c9f3b None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:26.353039 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df867e-5fc4-4682-ab47-f1df2d4c9f3b None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:26.357977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975c2fe-24c5-4ad0-9d59-7b32c1882ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:26.358636 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975c2fe-24c5-4ad0-9d59-7b32c1882ead service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:26.358928 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975c2fe-24c5-4ad0-9d59-7b32c1882ead service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:26.359210 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975c2fe-24c5-4ad0-9d59-7b32c1882ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:26.367771 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975c2fe-24c5-4ad0-9d59-7b32c1882ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:26.369358 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975c2fe-24c5-4ad0-9d59-7b32c1882ead service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:26.378744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 514/1048] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:27.301562 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2834436-84aa-4f7d-8938-1f1912c1e1b5 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:27.302073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2834436-84aa-4f7d-8938-1f1912c1e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:27.302073 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2834436-84aa-4f7d-8938-1f1912c1e1b5 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:27.303454 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 535/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:27.308973 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe76fb-7894-4639-861a-18e6ade80ba6 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:27.309395 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe76fb-7894-4639-861a-18e6ade80ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:27.309551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe76fb-7894-4639-861a-18e6ade80ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:27.328235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-9abe76fb-7894-4639-861a-18e6ade80ba6 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:27.329431 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-9abe76fb-7894-4639-861a-18e6ade80ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:27.337229 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 515/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:07:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:27.490942 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2834436-84aa-4f7d-8938-1f1912c1e1b5 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:27.504464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2834436-84aa-4f7d-8938-1f1912c1e1b5 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:27.509984 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce214c-391a-4077-8b75-0e2df070e0ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:27.510662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce214c-391a-4077-8b75-0e2df070e0ae service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:27.510952 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce214c-391a-4077-8b75-0e2df070e0ae service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:27.511236 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce214c-391a-4077-8b75-0e2df070e0ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:27.519866 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce214c-391a-4077-8b75-0e2df070e0ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:27.521469 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce214c-391a-4077-8b75-0e2df070e0ae service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:27.531564 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 536/1051] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:28.437662 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b1894-5d3f-414d-b017-93a8fc8e9a26 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:28.438237 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b1894-5d3f-414d-b017-93a8fc8e9a26 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:28.438237 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b1894-5d3f-414d-b017-93a8fc8e9a26 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:28.439644 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 516/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:28.444831 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966ee10-7c2a-4074-8a1e-6fa8cff3bcde None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:28.445250 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966ee10-7c2a-4074-8a1e-6fa8cff3bcde None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:28.445406 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966ee10-7c2a-4074-8a1e-6fa8cff3bcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:28.463094 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-9966ee10-7c2a-4074-8a1e-6fa8cff3bcde None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:28.464294 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-9966ee10-7c2a-4074-8a1e-6fa8cff3bcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:28.472031 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 537/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:07:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:07:28.627791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b1894-5d3f-414d-b017-93a8fc8e9a26 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:28.641340 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b1894-5d3f-414d-b017-93a8fc8e9a26 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:28.646783 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64475d-e9f8-451f-b6c4-69e4464ec570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:28.647989 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64475d-e9f8-451f-b6c4-69e4464ec570 service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:28.648274 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64475d-e9f8-451f-b6c4-69e4464ec570 service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:28.648550 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64475d-e9f8-451f-b6c4-69e4464ec570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:28.656537 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64475d-e9f8-451f-b6c4-69e4464ec570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:28.658106 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64475d-e9f8-451f-b6c4-69e4464ec570 service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:28.667999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 517/1054] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:29.627751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa2644-eb4c-451b-8162-b875cfe356f8 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:29.628335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa2644-eb4c-451b-8162-b875cfe356f8 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:29.628335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa2644-eb4c-451b-8162-b875cfe356f8 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:29.629678 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 538/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:29.636166 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5113-4bb4-43bc-966a-f019e4baf1e5 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:29.636600 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5113-4bb4-43bc-966a-f019e4baf1e5 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:29.636744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b5113-4bb4-43bc-966a-f019e4baf1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:29.655886 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-ff2b5113-4bb4-43bc-966a-f019e4baf1e5 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:29.657126 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-ff2b5113-4bb4-43bc-966a-f019e4baf1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:29.665725 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 518/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:07:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:29.821325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa2644-eb4c-451b-8162-b875cfe356f8 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:29.834684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa2644-eb4c-451b-8162-b875cfe356f8 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:29.840207 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101fe5b-16fd-4a38-9bd4-fdc800cd2c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:29.840847 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101fe5b-16fd-4a38-9bd4-fdc800cd2c57 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:29.841136 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101fe5b-16fd-4a38-9bd4-fdc800cd2c57 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:29.841416 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101fe5b-16fd-4a38-9bd4-fdc800cd2c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:29.849495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101fe5b-16fd-4a38-9bd4-fdc800cd2c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:29.851109 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101fe5b-16fd-4a38-9bd4-fdc800cd2c57 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:29.860452 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 539/1057] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:32.028462 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695154f9-ca70-424d-ae10-a42395f581a3 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:32.028954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695154f9-ca70-424d-ae10-a42395f581a3 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:32.029044 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695154f9-ca70-424d-ae10-a42395f581a3 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:32.030439 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 519/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:32.035761 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4c2d5-3d96-44a7-a096-f7e7abfb5341 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:32.036166 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4c2d5-3d96-44a7-a096-f7e7abfb5341 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:32.036366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4c2d5-3d96-44a7-a096-f7e7abfb5341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:32.053831 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-a4b4c2d5-3d96-44a7-a096-f7e7abfb5341 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:32.055063 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-a4b4c2d5-3d96-44a7-a096-f7e7abfb5341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:32.062853 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 540/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:32.102141 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695154f9-ca70-424d-ae10-a42395f581a3 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:32.112768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695154f9-ca70-424d-ae10-a42395f581a3 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:32.116241 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ec083-b6fd-44ad-829b-4def6027b95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:32.116877 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ec083-b6fd-44ad-829b-4def6027b95f service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:32.117164 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ec083-b6fd-44ad-829b-4def6027b95f service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:32.117445 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ec083-b6fd-44ad-829b-4def6027b95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:32.126209 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ec083-b6fd-44ad-829b-4def6027b95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:32.127679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ec083-b6fd-44ad-829b-4def6027b95f service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:32.137650 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 520/1060] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:34.595682 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be0c46-b8f6-4909-971a-f44c25924861 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:34.596273 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be0c46-b8f6-4909-971a-f44c25924861 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:34.596273 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be0c46-b8f6-4909-971a-f44c25924861 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:34.597608 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 541/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:34.602948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83383ae-8eb8-4f3b-9533-5c66ba4578e5 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:34.603386 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83383ae-8eb8-4f3b-9533-5c66ba4578e5 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:34.603527 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83383ae-8eb8-4f3b-9533-5c66ba4578e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:34.622230 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-c83383ae-8eb8-4f3b-9533-5c66ba4578e5 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:34.623474 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-c83383ae-8eb8-4f3b-9533-5c66ba4578e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:34.631489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 521/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:34.670949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be0c46-b8f6-4909-971a-f44c25924861 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:34.682058 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be0c46-b8f6-4909-971a-f44c25924861 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:34.685519 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7e9c-219f-4e93-8819-57b2df615a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:34.686155 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7e9c-219f-4e93-8819-57b2df615a48 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:34.686474 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7e9c-219f-4e93-8819-57b2df615a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:34.686757 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7e9c-219f-4e93-8819-57b2df615a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:34.696098 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f7e9c-219f-4e93-8819-57b2df615a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:34.697546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f7e9c-219f-4e93-8819-57b2df615a48 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:34.708684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 542/1063] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:37.440867 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed202270-0bf6-4e31-a8ee-48467b6f62db None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:37.441443 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed202270-0bf6-4e31-a8ee-48467b6f62db None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:37.441443 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed202270-0bf6-4e31-a8ee-48467b6f62db None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:37.442835 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 522/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:37.448344 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b22a2c-0631-4101-94c2-97103bc84ced None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:37.448748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b22a2c-0631-4101-94c2-97103bc84ced None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:37.448936 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b22a2c-0631-4101-94c2-97103bc84ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:37.466500 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-87b22a2c-0631-4101-94c2-97103bc84ced None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:37.467684 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-87b22a2c-0631-4101-94c2-97103bc84ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:37.475958 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 543/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:37.516052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed202270-0bf6-4e31-a8ee-48467b6f62db None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:37.527273 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed202270-0bf6-4e31-a8ee-48467b6f62db None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:37.530787 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fa3a0-c753-4532-a48c-a88fa88e33f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:37.531517 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa3a0-c753-4532-a48c-a88fa88e33f7 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:37.531808 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa3a0-c753-4532-a48c-a88fa88e33f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:37.532089 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa3a0-c753-4532-a48c-a88fa88e33f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:37.541840 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fa3a0-c753-4532-a48c-a88fa88e33f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:37.543296 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fa3a0-c753-4532-a48c-a88fa88e33f7 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:37.552944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 523/1066] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:39.973580 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b0596-418a-4717-a566-3bc0299b599c None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:39.973995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b0596-418a-4717-a566-3bc0299b599c None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:39.974151 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b0596-418a-4717-a566-3bc0299b599c None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:39.975599 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 544/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:39.980960 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8aff0-4410-439f-a7ac-7d0314ca99be None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:39.981398 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8aff0-4410-439f-a7ac-7d0314ca99be None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:39.981540 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8aff0-4410-439f-a7ac-7d0314ca99be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:39.999936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-49d8aff0-4410-439f-a7ac-7d0314ca99be None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:40.001229 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-49d8aff0-4410-439f-a7ac-7d0314ca99be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:40.009688 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 524/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:40.049099 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b0596-418a-4717-a566-3bc0299b599c None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:40.060435 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b0596-418a-4717-a566-3bc0299b599c None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:40.063972 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca10a3-5c9a-4bf0-a581-07ad34a221c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:40.064651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca10a3-5c9a-4bf0-a581-07ad34a221c2 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:40.064944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca10a3-5c9a-4bf0-a581-07ad34a221c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:40.065224 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca10a3-5c9a-4bf0-a581-07ad34a221c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:40.074750 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca10a3-5c9a-4bf0-a581-07ad34a221c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:40.076193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca10a3-5c9a-4bf0-a581-07ad34a221c2 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:40.085617 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 545/1069] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:42.505798 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb20ce-e08f-477e-8d46-83421ee02fbe None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:42.506508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb20ce-e08f-477e-8d46-83421ee02fbe None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:42.506508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb20ce-e08f-477e-8d46-83421ee02fbe None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:42.507838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 525/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:42.513280 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d52b-e892-4cb4-9cd2-c28c95d2c7e3 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:42.513690 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d52b-e892-4cb4-9cd2-c28c95d2c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:42.513864 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d52b-e892-4cb4-9cd2-c28c95d2c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:42.532471 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-3d01d52b-e892-4cb4-9cd2-c28c95d2c7e3 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:42.533647 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-3d01d52b-e892-4cb4-9cd2-c28c95d2c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:42.542855 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 546/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:42.581327 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb20ce-e08f-477e-8d46-83421ee02fbe None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:42.591973 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb20ce-e08f-477e-8d46-83421ee02fbe None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:42.595471 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2511196-e62a-4a7d-82a5-324b9e47ea95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:42.596111 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511196-e62a-4a7d-82a5-324b9e47ea95 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:42.596403 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511196-e62a-4a7d-82a5-324b9e47ea95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:42.596692 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511196-e62a-4a7d-82a5-324b9e47ea95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:42.606063 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2511196-e62a-4a7d-82a5-324b9e47ea95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:42.607529 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2511196-e62a-4a7d-82a5-324b9e47ea95 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:42.619793 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 526/1072] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:44.972707 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e39378-f008-49c5-81b2-1965237c4a66 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:44.973226 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e39378-f008-49c5-81b2-1965237c4a66 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:44.973345 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e39378-f008-49c5-81b2-1965237c4a66 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:44.974657 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 547/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:44.979936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a3848-53f2-425c-b30b-7b8ee4a53511 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:44.980378 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a3848-53f2-425c-b30b-7b8ee4a53511 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:44.980513 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a3848-53f2-425c-b30b-7b8ee4a53511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:44.997959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-806a3848-53f2-425c-b30b-7b8ee4a53511 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:44.999209 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-806a3848-53f2-425c-b30b-7b8ee4a53511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:45.007538 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 527/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:07:45.047015 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e39378-f008-49c5-81b2-1965237c4a66 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:45.058514 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e39378-f008-49c5-81b2-1965237c4a66 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:45.062615 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82edda1-16a9-4578-89e1-af66614ecaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:45.067992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82edda1-16a9-4578-89e1-af66614ecaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:45.067992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82edda1-16a9-4578-89e1-af66614ecaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:45.067992 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82edda1-16a9-4578-89e1-af66614ecaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:45.073892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82edda1-16a9-4578-89e1-af66614ecaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:45.075535 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82edda1-16a9-4578-89e1-af66614ecaf2 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:45.084990 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 548/1075] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:47.466461 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58de88-e276-45a4-ac19-576ca3609cb8 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:47.467051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58de88-e276-45a4-ac19-576ca3609cb8 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:47.467051 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58de88-e276-45a4-ac19-576ca3609cb8 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:47.468416 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 528/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:47.473904 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc27fd-df9f-48f5-9824-7c34a4aeaec3 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:47.474321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc27fd-df9f-48f5-9824-7c34a4aeaec3 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:47.474522 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc27fd-df9f-48f5-9824-7c34a4aeaec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:47.481336 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=70 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:07:47.493238 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-44fc27fd-df9f-48f5-9824-7c34a4aeaec3 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:47.494489 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-44fc27fd-df9f-48f5-9824-7c34a4aeaec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:47.502275 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 549/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:47.541410 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58de88-e276-45a4-ac19-576ca3609cb8 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:47.546834 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=78 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:07:47.552515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58de88-e276-45a4-ac19-576ca3609cb8 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:47.556119 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4333a-f387-4a06-9394-d3a04a1cc2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:47.556755 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4333a-f387-4a06-9394-d3a04a1cc2da service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:47.557048 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4333a-f387-4a06-9394-d3a04a1cc2da service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:47.557335 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4333a-f387-4a06-9394-d3a04a1cc2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:47.566114 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4333a-f387-4a06-9394-d3a04a1cc2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:47.567595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4333a-f387-4a06-9394-d3a04a1cc2da service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:47.576968 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 529/1078] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:49.915373 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fbf0c-fd3b-49ef-af0d-52adf77347fe None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:49.915812 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fbf0c-fd3b-49ef-af0d-52adf77347fe None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:49.915944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fbf0c-fd3b-49ef-af0d-52adf77347fe None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:49.917356 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 550/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 07:07:49.922944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae43a5b-cad5-418c-ac29-d501abfc9fcd None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:49.923399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae43a5b-cad5-418c-ac29-d501abfc9fcd None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:49.923593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae43a5b-cad5-418c-ac29-d501abfc9fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:49.941924 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-dae43a5b-cad5-418c-ac29-d501abfc9fcd None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:49.943166 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-dae43a5b-cad5-418c-ac29-d501abfc9fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:49.951589 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 530/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:49.989574 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fbf0c-fd3b-49ef-af0d-52adf77347fe None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:50.000858 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fbf0c-fd3b-49ef-af0d-52adf77347fe None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:50.004340 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab0f2e-3a43-446a-9309-9e8f8c218429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:50.004970 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab0f2e-3a43-446a-9309-9e8f8c218429 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:50.005256 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab0f2e-3a43-446a-9309-9e8f8c218429 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:50.005530 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab0f2e-3a43-446a-9309-9e8f8c218429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:50.014272 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab0f2e-3a43-446a-9309-9e8f8c218429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:50.016016 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab0f2e-3a43-446a-9309-9e8f8c218429 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:50.025680 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 551/1081] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:52.362121 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c206c9-6bd1-41cb-82ef-0fb9ec27515f None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:52.362705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c206c9-6bd1-41cb-82ef-0fb9ec27515f None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:52.362705 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c206c9-6bd1-41cb-82ef-0fb9ec27515f None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:52.364077 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 531/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:52.369859 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca27a-d76e-444a-b7d9-8edb327fe2d6 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:52.370321 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca27a-d76e-444a-b7d9-8edb327fe2d6 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:52.370467 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca27a-d76e-444a-b7d9-8edb327fe2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:52.387868 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-922ca27a-d76e-444a-b7d9-8edb327fe2d6 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:52.389044 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-922ca27a-d76e-444a-b7d9-8edb327fe2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:52.396964 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 552/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:07:52.434222 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c206c9-6bd1-41cb-82ef-0fb9ec27515f None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:52.444754 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c206c9-6bd1-41cb-82ef-0fb9ec27515f None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:52.448260 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03597791-5527-40ab-be1b-3d25f0e74868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:52.448890 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597791-5527-40ab-be1b-3d25f0e74868 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:52.449176 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597791-5527-40ab-be1b-3d25f0e74868 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:52.449456 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597791-5527-40ab-be1b-3d25f0e74868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:52.458379 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03597791-5527-40ab-be1b-3d25f0e74868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:52.459830 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03597791-5527-40ab-be1b-3d25f0e74868 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:52.469352 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 532/1084] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:07:54.778888 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9826e0-d586-4bed-b502-5a4d40c3efe0 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:54.779455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9826e0-d586-4bed-b502-5a4d40c3efe0 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:54.779455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9826e0-d586-4bed-b502-5a4d40c3efe0 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:54.780829 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 553/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:07:54.786163 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2163-159a-4b28-bcd0-47faf28a2dd6 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:54.786576 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2163-159a-4b28-bcd0-47faf28a2dd6 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:54.786772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2163-159a-4b28-bcd0-47faf28a2dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:54.804679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-4fdf2163-159a-4b28-bcd0-47faf28a2dd6 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:07:54.805864 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-4fdf2163-159a-4b28-bcd0-47faf28a2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:07:54.813761 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 533/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:07:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:07:54.850556 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9826e0-d586-4bed-b502-5a4d40c3efe0 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:07:54.861105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9826e0-d586-4bed-b502-5a4d40c3efe0 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:07:54.864545 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db331-8c2a-45c9-b27e-0a2a5b93dd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:07:54.865178 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db331-8c2a-45c9-b27e-0a2a5b93dd0b service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:07:54.865463 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db331-8c2a-45c9-b27e-0a2a5b93dd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:07:54.866246 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db331-8c2a-45c9-b27e-0a2a5b93dd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:07:54.875144 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732db331-8c2a-45c9-b27e-0a2a5b93dd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:07:54.876578 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732db331-8c2a-45c9-b27e-0a2a5b93dd0b service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:07:54.886491 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 554/1087] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:07:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:08:04.799136 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=17 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:08:04.882270 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=17 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:08:27.820930 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ae23-44db-47ee-ab3a-79e99aa9d867 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:27.821532 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ae23-44db-47ee-ab3a-79e99aa9d867 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:27.821532 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ae23-44db-47ee-ab3a-79e99aa9d867 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:27.822936 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 534/1088] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:08:27.828007 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fac8b-5b7f-497c-9a86-8ac7e40f2f37 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:27.828417 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fac8b-5b7f-497c-9a86-8ac7e40f2f37 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:27.828569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fac8b-5b7f-497c-9a86-8ac7e40f2f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:27.845916 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-bb3fac8b-5b7f-497c-9a86-8ac7e40f2f37 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:08:27.847142 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-bb3fac8b-5b7f-497c-9a86-8ac7e40f2f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:08:27.854891 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 555/1089] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:08:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:08:27.903450 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a0adc-164e-426b-83a3-75a8d00a8471 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:27.903745 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a0adc-164e-426b-83a3-75a8d00a8471 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:27.904026 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a0adc-164e-426b-83a3-75a8d00a8471 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:27.905368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 535/1090] 10.222.0.42 () {54 vars in 962 bytes} [Mon Jun 6 07:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:08:27.910656 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441f76-0a8d-4356-af79-a655a2488bc3 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:27.910953 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441f76-0a8d-4356-af79-a655a2488bc3 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:27.911237 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27441f76-0a8d-4356-af79-a655a2488bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:27.947932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-27441f76-0a8d-4356-af79-a655a2488bc3 None None] MFA Rules not processed for user `b1618d2efb0c45f98a081126f5342abc`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:08:27.949159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-27441f76-0a8d-4356-af79-a655a2488bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:08:27.955612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 556/1091] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Jun 6 07:08:27 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:08:27.962977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a0adc-164e-426b-83a3-75a8d00a8471 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:08:27.973417 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a0adc-164e-426b-83a3-75a8d00a8471 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:08:27.976916 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c04b2b-ba8d-4a75-9a8b-e84c835c2f9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1618d2efb0c45f98a081126f5342abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:08:27.977547 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c04b2b-ba8d-4a75-9a8b-e84c835c2f9c service glance] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:27.977837 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c04b2b-ba8d-4a75-9a8b-e84c835c2f9c service glance] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:27.978118 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c04b2b-ba8d-4a75-9a8b-e84c835c2f9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:27.986889 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c04b2b-ba8d-4a75-9a8b-e84c835c2f9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:08:27.988350 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c04b2b-ba8d-4a75-9a8b-e84c835c2f9c service glance] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:08:27.998734 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 536/1092] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:08:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:08:30.380730 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02f5d0-0734-4380-bb71-ed9266ca5894 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:30.381296 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02f5d0-0734-4380-bb71-ed9266ca5894 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:30.381402 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02f5d0-0734-4380-bb71-ed9266ca5894 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:30.382799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 557/1093] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:08:30.388072 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0485ec1-e740-4f0b-9535-b0521104c04d None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:30.388487 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0485ec1-e740-4f0b-9535-b0521104c04d None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:30.388653 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0485ec1-e740-4f0b-9535-b0521104c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:30.407036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-d0485ec1-e740-4f0b-9535-b0521104c04d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:08:30.408244 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-d0485ec1-e740-4f0b-9535-b0521104c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:08:30.416967 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 537/1094] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:08:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:08:30.441172 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02f5d0-0734-4380-bb71-ed9266ca5894 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:08:30.453999 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02f5d0-0734-4380-bb71-ed9266ca5894 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:08:30.458428 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863a02-d6ca-4e6a-96da-674213039d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:08:30.459067 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863a02-d6ca-4e6a-96da-674213039d57 admin admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:30.459974 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863a02-d6ca-4e6a-96da-674213039d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:30.460258 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863a02-d6ca-4e6a-96da-674213039d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:30.460988 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25863a02-d6ca-4e6a-96da-674213039d57 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:08:30.462785 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING py.warnings [None req-25863a02-d6ca-4e6a-96da-674213039d57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:08:30.462785 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: warnings.warn(msg) Jun 06 07:08:30.462785 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: Jun 06 07:08:30.463930 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25863a02-d6ca-4e6a-96da-674213039d57 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:08:30.481639 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 558/1095] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Jun 6 07:08:30 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 07:08:32.820419 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e4c84-936a-4080-96f8-7572fcac4ef3 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:32.820960 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e4c84-936a-4080-96f8-7572fcac4ef3 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:32.820960 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e4c84-936a-4080-96f8-7572fcac4ef3 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:32.822370 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 538/1096] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:08:32.827643 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bcefb-a4c1-44a0-9d5f-c79cc99302b6 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:32.828085 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bcefb-a4c1-44a0-9d5f-c79cc99302b6 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:32.828199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bcefb-a4c1-44a0-9d5f-c79cc99302b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:32.845785 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-3f2bcefb-a4c1-44a0-9d5f-c79cc99302b6 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:08:32.847014 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-3f2bcefb-a4c1-44a0-9d5f-c79cc99302b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:08:32.855329 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 559/1097] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:08:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:08:32.898919 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e4c84-936a-4080-96f8-7572fcac4ef3 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:08:32.914638 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e4c84-936a-4080-96f8-7572fcac4ef3 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:08:32.919510 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e03200-b731-474b-8197-02be9d4a13d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:08:32.920153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03200-b731-474b-8197-02be9d4a13d8 service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:32.920443 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03200-b731-474b-8197-02be9d4a13d8 service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:32.920721 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03200-b731-474b-8197-02be9d4a13d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:32.929937 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03200-b731-474b-8197-02be9d4a13d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:08:32.931589 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03200-b731-474b-8197-02be9d4a13d8 service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:08:32.941855 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 539/1098] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:08:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:08:35.438388 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512b73f-19c6-495b-a538-2e47d13fe132 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:35.438961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512b73f-19c6-495b-a538-2e47d13fe132 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:35.438961 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512b73f-19c6-495b-a538-2e47d13fe132 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:35.440328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 560/1099] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:08:35.446370 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aef9e8-378d-4fdf-b2f8-286a2abc794a None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:35.446796 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aef9e8-378d-4fdf-b2f8-286a2abc794a None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:35.446949 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aef9e8-378d-4fdf-b2f8-286a2abc794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:35.464476 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-80aef9e8-378d-4fdf-b2f8-286a2abc794a None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:08:35.465687 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-80aef9e8-378d-4fdf-b2f8-286a2abc794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:08:35.473557 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 540/1100] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:08:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:08:35.510885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512b73f-19c6-495b-a538-2e47d13fe132 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:08:35.524741 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512b73f-19c6-495b-a538-2e47d13fe132 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:08:35.528772 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7feb7-fea4-4c90-b05a-f0774f04af1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:08:35.529488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7feb7-fea4-4c90-b05a-f0774f04af1f service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:35.529849 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7feb7-fea4-4c90-b05a-f0774f04af1f service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:35.530060 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7feb7-fea4-4c90-b05a-f0774f04af1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:35.539934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7feb7-fea4-4c90-b05a-f0774f04af1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:08:35.541367 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7feb7-fea4-4c90-b05a-f0774f04af1f service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:08:35.550814 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 561/1101] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:08:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 07:08:37.892488 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11c8df-0bfe-48b6-99d3-6945497e85b9 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:37.893064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11c8df-0bfe-48b6-99d3-6945497e85b9 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:37.893064 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11c8df-0bfe-48b6-99d3-6945497e85b9 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:37.894451 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 541/1102] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:08:37.900612 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e85c-55a8-46dd-9a01-175ea08d84a2 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:37.901036 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e85c-55a8-46dd-9a01-175ea08d84a2 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:37.901168 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e85c-55a8-46dd-9a01-175ea08d84a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:37.919408 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-ac96e85c-55a8-46dd-9a01-175ea08d84a2 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:08:37.920599 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-ac96e85c-55a8-46dd-9a01-175ea08d84a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:08:37.928306 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 562/1103] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:08:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:08:37.966593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11c8df-0bfe-48b6-99d3-6945497e85b9 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:08:37.977176 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11c8df-0bfe-48b6-99d3-6945497e85b9 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:08:37.980674 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab9d19-2e2f-46d2-bf22-2c46bf279f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:08:37.981305 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab9d19-2e2f-46d2-bf22-2c46bf279f35 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:37.981591 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab9d19-2e2f-46d2-bf22-2c46bf279f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:37.981870 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab9d19-2e2f-46d2-bf22-2c46bf279f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:37.990585 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab9d19-2e2f-46d2-bf22-2c46bf279f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:08:37.992001 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab9d19-2e2f-46d2-bf22-2c46bf279f35 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:08:38.001243 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 542/1104] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:08:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:08:40.439348 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefec4b-b326-4dd6-b60f-add2cbf5c5fb None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:40.439914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefec4b-b326-4dd6-b60f-add2cbf5c5fb None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:40.439914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefec4b-b326-4dd6-b60f-add2cbf5c5fb None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:40.441285 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 563/1105] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:08:40.446692 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7a8f-0823-4b64-9ab4-517a3b0b33ac None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:40.447124 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7a8f-0823-4b64-9ab4-517a3b0b33ac None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:40.447278 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7a8f-0823-4b64-9ab4-517a3b0b33ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:40.464647 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-759a7a8f-0823-4b64-9ab4-517a3b0b33ac None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:08:40.465847 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-759a7a8f-0823-4b64-9ab4-517a3b0b33ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:08:40.473585 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 543/1106] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:08:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:08:40.513958 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefec4b-b326-4dd6-b60f-add2cbf5c5fb None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:08:40.525244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefec4b-b326-4dd6-b60f-add2cbf5c5fb None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:08:40.532626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec261327-0b0a-4e80-aaee-2580e5bdb7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:08:40.532626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec261327-0b0a-4e80-aaee-2580e5bdb7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:40.532626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec261327-0b0a-4e80-aaee-2580e5bdb7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:40.532626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec261327-0b0a-4e80-aaee-2580e5bdb7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:40.539403 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec261327-0b0a-4e80-aaee-2580e5bdb7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:08:40.540829 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec261327-0b0a-4e80-aaee-2580e5bdb7a6 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:08:40.550150 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 564/1107] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:08:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:08:43.376634 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a199d0-1068-4631-8046-a9011a0c24e8 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:43.377200 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a199d0-1068-4631-8046-a9011a0c24e8 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:43.377200 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a199d0-1068-4631-8046-a9011a0c24e8 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:43.379842 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 544/1108] 10.222.0.42 () {54 vars in 926 bytes} [Mon Jun 6 07:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:08:43.384160 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceaada-f053-47da-8f84-55d6eccff383 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:43.384614 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceaada-f053-47da-8f84-55d6eccff383 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:43.384722 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceaada-f053-47da-8f84-55d6eccff383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:43.402866 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-34ceaada-f053-47da-8f84-55d6eccff383 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:08:43.404071 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-34ceaada-f053-47da-8f84-55d6eccff383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:08:43.412004 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 565/1109] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Jun 6 07:08:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:08:43.452979 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a199d0-1068-4631-8046-a9011a0c24e8 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:08:43.463629 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a199d0-1068-4631-8046-a9011a0c24e8 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:08:43.467146 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9244060-eb66-41ca-8fdd-6c9f897cea63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:08:43.471882 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9244060-eb66-41ca-8fdd-6c9f897cea63 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:08:43.471882 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9244060-eb66-41ca-8fdd-6c9f897cea63 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:08:43.471882 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9244060-eb66-41ca-8fdd-6c9f897cea63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:08:43.477745 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9244060-eb66-41ca-8fdd-6c9f897cea63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:08:43.479216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9244060-eb66-41ca-8fdd-6c9f897cea63 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:08:43.488603 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 545/1110] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:08:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:08:53.397654 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=38 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:08:53.484465 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=33 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:10:19.099913 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1335c-164a-4503-ac78-15b2279b6c77 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.100532 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1335c-164a-4503-ac78-15b2279b6c77 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.100532 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1335c-164a-4503-ac78-15b2279b6c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.123847 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-f1e1335c-164a-4503-ac78-15b2279b6c77 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:10:19.125022 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-f1e1335c-164a-4503-ac78-15b2279b6c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:10:19.133363 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 566/1111] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:10:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:10:19.140949 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393e9b-7aae-400a-9eba-2df82201778d None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.141452 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393e9b-7aae-400a-9eba-2df82201778d None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.141607 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393e9b-7aae-400a-9eba-2df82201778d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.159768 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-68393e9b-7aae-400a-9eba-2df82201778d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:10:19.160981 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-68393e9b-7aae-400a-9eba-2df82201778d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:10:19.169277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 546/1112] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:10:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:10:19.173534 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1335c-164a-4503-ac78-15b2279b6c77 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:19.183565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1335c-164a-4503-ac78-15b2279b6c77 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:19.188026 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:19.188666 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.188948 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.189225 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.189941 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 07:10:19.190274 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:19.191307 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING py.warnings [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:10:19.191307 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: warnings.warn(msg) Jun 06 07:10:19.191307 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: Jun 06 07:10:19.192177 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:19.203691 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 567/1113] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jun 6 07:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 07:10:19.211436 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68393e9b-7aae-400a-9eba-2df82201778d None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:19.220475 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68393e9b-7aae-400a-9eba-2df82201778d None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:19.225076 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21eeded-f8fc-4906-8ac1-90e1dd926fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:19.225723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eeded-f8fc-4906-8ac1-90e1dd926fcc admin admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.226014 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eeded-f8fc-4906-8ac1-90e1dd926fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.226843 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eeded-f8fc-4906-8ac1-90e1dd926fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.227546 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21eeded-f8fc-4906-8ac1-90e1dd926fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:19.229340 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WARNING py.warnings [None req-a21eeded-f8fc-4906-8ac1-90e1dd926fcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:10:19.229340 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: warnings.warn(msg) Jun 06 07:10:19.229340 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: Jun 06 07:10:19.230570 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21eeded-f8fc-4906-8ac1-90e1dd926fcc admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:19.348418 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 547/1114] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jun 6 07:10:19 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 07:10:19.352985 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:19.362667 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e4e1d-b19b-4097-8118-6dd09251888b admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:19.423669 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00697de0-3b65-4ff7-863b-2f49796b710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:19.424270 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00697de0-3b65-4ff7-863b-2f49796b710e admin admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.424554 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00697de0-3b65-4ff7-863b-2f49796b710e admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.424835 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00697de0-3b65-4ff7-863b-2f49796b710e admin admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.425532 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00697de0-3b65-4ff7-863b-2f49796b710e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:19.426577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING py.warnings [None req-00697de0-3b65-4ff7-863b-2f49796b710e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:10:19.426577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: warnings.warn(msg) Jun 06 07:10:19.426577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: Jun 06 07:10:19.427775 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00697de0-3b65-4ff7-863b-2f49796b710e admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:19.534924 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 568/1115] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jun 6 07:10:19 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 07:10:19.539082 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21eeded-f8fc-4906-8ac1-90e1dd926fcc admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:19.549876 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21eeded-f8fc-4906-8ac1-90e1dd926fcc admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:19.554585 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b41bb-5d49-4f2d-b2c2-5d997dff145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:19.555253 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b41bb-5d49-4f2d-b2c2-5d997dff145b admin admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.555542 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b41bb-5d49-4f2d-b2c2-5d997dff145b admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.555824 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b41bb-5d49-4f2d-b2c2-5d997dff145b admin admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.556557 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b41bb-5d49-4f2d-b2c2-5d997dff145b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:19.557582 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WARNING py.warnings [None req-d71b41bb-5d49-4f2d-b2c2-5d997dff145b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:10:19.557582 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: warnings.warn(msg) Jun 06 07:10:19.557582 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: Jun 06 07:10:19.558496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b41bb-5d49-4f2d-b2c2-5d997dff145b admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:19.571400 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 548/1116] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 07:10:19.575439 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00697de0-3b65-4ff7-863b-2f49796b710e admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:19.585380 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00697de0-3b65-4ff7-863b-2f49796b710e admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:19.590643 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b58fe8-c325-4dd2-b142-6bcedf8df90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:19.591296 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b58fe8-c325-4dd2-b142-6bcedf8df90b admin admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.591581 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b58fe8-c325-4dd2-b142-6bcedf8df90b admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.591861 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b58fe8-c325-4dd2-b142-6bcedf8df90b admin admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.592628 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b58fe8-c325-4dd2-b142-6bcedf8df90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:19.593641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING py.warnings [None req-a3b58fe8-c325-4dd2-b142-6bcedf8df90b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:10:19.593641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: warnings.warn(msg) Jun 06 07:10:19.593641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: Jun 06 07:10:19.594550 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b58fe8-c325-4dd2-b142-6bcedf8df90b admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:19.608678 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 569/1117] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 07:10:19.612853 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b41bb-5d49-4f2d-b2c2-5d997dff145b admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:19.622809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b41bb-5d49-4f2d-b2c2-5d997dff145b admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:19.627513 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ef5c5-7d46-47e9-a14e-eec9fa6746a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:19.628389 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ef5c5-7d46-47e9-a14e-eec9fa6746a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.628679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ef5c5-7d46-47e9-a14e-eec9fa6746a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.628963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ef5c5-7d46-47e9-a14e-eec9fa6746a6 admin admin] PATH_INFO: `/v3/projects/09d1257de46f4943997cc90ee7b08e71/users/b026bbf7755c484dbb7503293b546ce1/roles/030683e4ff8d4d1587d99164f75c0fb8` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.643681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ef5c5-7d46-47e9-a14e-eec9fa6746a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d1257de46f4943997cc90ee7b08e71, user_id=b026bbf7755c484dbb7503293b546ce1, role_id=030683e4ff8d4d1587d99164f75c0fb8)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:19.644753 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WARNING py.warnings [None req-137ef5c5-7d46-47e9-a14e-eec9fa6746a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:10:19.644753 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: warnings.warn(msg) Jun 06 07:10:19.644753 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: Jun 06 07:10:19.646790 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ef5c5-7d46-47e9-a14e-eec9fa6746a6 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:19.752334 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 549/1118] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jun 6 07:10:19 2022] PUT /identity/v3/projects/09d1257de46f4943997cc90ee7b08e71/users/b026bbf7755c484dbb7503293b546ce1/roles/030683e4ff8d4d1587d99164f75c0fb8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:10:19.764434 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e3f7f-95ba-4325-8e13-535038528ed7 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.764747 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e3f7f-95ba-4325-8e13-535038528ed7 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.765035 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e3f7f-95ba-4325-8e13-535038528ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.794983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-0b8e3f7f-95ba-4325-8e13-535038528ed7 None None] MFA Rules not processed for user `b026bbf7755c484dbb7503293b546ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:10:19.796193 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-0b8e3f7f-95ba-4325-8e13-535038528ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:10:19.858962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 570/1119] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:10:19 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:10:19.872029 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3c67-0be3-427e-b2c7-36a586799770 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.872324 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3c67-0be3-427e-b2c7-36a586799770 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.872610 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3c67-0be3-427e-b2c7-36a586799770 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.873965 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 550/1120] 10.222.0.42 () {54 vars in 963 bytes} [Mon Jun 6 07:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:10:19.879029 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546cfea-e135-413e-a576-be35a390c727 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.879325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546cfea-e135-413e-a576-be35a390c727 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.882949 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546cfea-e135-413e-a576-be35a390c727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.910169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-a546cfea-e135-413e-a576-be35a390c727 None None] MFA Rules not processed for user `1c3429d0ba28474698c6c168270d314b`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:10:19.911401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-a546cfea-e135-413e-a576-be35a390c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:10:19.943592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:10:19.963011 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 571/1121] 10.222.0.42 () {58 vars in 1060 bytes} [Mon Jun 6 07:10:19 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:10:19.970960 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3c67-0be3-427e-b2c7-36a586799770 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:19.981587 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3c67-0be3-427e-b2c7-36a586799770 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:19.985044 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604905-4413-4d0a-90b5-552c52033279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3429d0ba28474698c6c168270d314b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:19.985676 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604905-4413-4d0a-90b5-552c52033279 service cinder] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:19.985959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604905-4413-4d0a-90b5-552c52033279 service cinder] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:19.986235 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604905-4413-4d0a-90b5-552c52033279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:19.994763 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604905-4413-4d0a-90b5-552c52033279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:19.996180 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604905-4413-4d0a-90b5-552c52033279 service cinder] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:20.004831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 551/1122] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:10:19 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:10:20.041465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa289c-9aaf-44e2-9316-0fb7aac7cf1d None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:20.041759 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa289c-9aaf-44e2-9316-0fb7aac7cf1d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:20.042038 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa289c-9aaf-44e2-9316-0fb7aac7cf1d None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:20.043334 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 572/1123] 10.222.0.42 () {52 vars in 829 bytes} [Mon Jun 6 07:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:10:20.047019 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604905-4413-4d0a-90b5-552c52033279 service cinder] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:20.109066 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604905-4413-4d0a-90b5-552c52033279 service cinder] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:20.113681 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:20.114702 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:20.114997 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:20.115279 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] PATH_INFO: `/v3/users/b026bbf7755c484dbb7503293b546ce1` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:20.116484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b026bbf7755c484dbb7503293b546ce1)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:20.117589 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WARNING py.warnings [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:10:20.117589 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: warnings.warn(msg) Jun 06 07:10:20.117589 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: Jun 06 07:10:20.118843 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:20.297618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b026bbf7755c484dbb7503293b546ce1'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:20.315568 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b026bbf7755c484dbb7503293b546ce1'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:20.316348 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b026bbf7755c484dbb7503293b546ce1'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:20.316982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b026bbf7755c484dbb7503293b546ce1'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:20.399959 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b026bbf7755c484dbb7503293b546ce1'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:20.408916 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:10:20.419062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 552/1124] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jun 6 07:10:20 2022] DELETE /identity/v3/users/b026bbf7755c484dbb7503293b546ce1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:10:20.423459 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d982f95-2f12-42cb-91b8-dec086b25fdb None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:20.423936 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d982f95-2f12-42cb-91b8-dec086b25fdb None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:20.424040 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d982f95-2f12-42cb-91b8-dec086b25fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:20.488150 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-8d982f95-2f12-42cb-91b8-dec086b25fdb None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:10:20.489339 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-8d982f95-2f12-42cb-91b8-dec086b25fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:10:20.546887 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 573/1125] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:10:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:10:20.556269 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:20.557689 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:10:20.632252 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f64d5-6019-4e1a-8bdf-86f7c3a32b10 admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:20.636504 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558cf0f-541a-4829-8f11-b46023e9901a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:20.637153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558cf0f-541a-4829-8f11-b46023e9901a service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:20.637438 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558cf0f-541a-4829-8f11-b46023e9901a service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:20.637747 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558cf0f-541a-4829-8f11-b46023e9901a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:20.647070 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558cf0f-541a-4829-8f11-b46023e9901a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:20.649375 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558cf0f-541a-4829-8f11-b46023e9901a service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:20.658934 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 553/1126] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:10:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:10:21.126585 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d982f95-2f12-42cb-91b8-dec086b25fdb None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:10:21.128012 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-8d982f95-2f12-42cb-91b8-dec086b25fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:10:21.140703 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d982f95-2f12-42cb-91b8-dec086b25fdb None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:10:21.146852 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:10:21.146852 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:10:21.146852 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:10:21.146852 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] PATH_INFO: `/v3/projects/09d1257de46f4943997cc90ee7b08e71` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:10:21.149561 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d1257de46f4943997cc90ee7b08e71)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:10:21.151128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING py.warnings [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:10:21.151128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: warnings.warn(msg) Jun 06 07:10:21.151128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: Jun 06 07:10:21.152874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:10:21.271325 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d1257de46f4943997cc90ee7b08e71', 'request_id': 'req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:21.277956 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d1257de46f4943997cc90ee7b08e71', 'request_id': 'req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:21.291620 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d1257de46f4943997cc90ee7b08e71', 'request_id': 'req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:21.357282 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] The token cache is being invalidate because project 09d1257de46f4943997cc90ee7b08e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 07:10:21.357575 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:21.358348 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-9cdf1443-cfd8-4f79-9388-c8714b0d4a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:10:21.359900 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 574/1127] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jun 6 07:10:21 2022] DELETE /identity/v3/projects/09d1257de46f4943997cc90ee7b08e71 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:10:30.654723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=34 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:10:31.354021 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:11:46.498723 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c696d-a94a-4d83-acbe-af660afe54b4 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:46.499320 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c696d-a94a-4d83-acbe-af660afe54b4 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:46.499433 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c696d-a94a-4d83-acbe-af660afe54b4 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:46.500843 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 554/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:11:46.505738 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19ff62-ea3d-4656-adda-83c523d48551 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:46.506147 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19ff62-ea3d-4656-adda-83c523d48551 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:46.506307 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19ff62-ea3d-4656-adda-83c523d48551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:46.524079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-6c19ff62-ea3d-4656-adda-83c523d48551 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:11:46.525561 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-6c19ff62-ea3d-4656-adda-83c523d48551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:11:46.584857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 575/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:11:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:11:46.759755 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c696d-a94a-4d83-acbe-af660afe54b4 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:11:46.761496 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-0c0c696d-a94a-4d83-acbe-af660afe54b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:11:46.831529 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c696d-a94a-4d83-acbe-af660afe54b4 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:11:46.836468 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25b6bb-d5f2-4cb6-a7db-333a3d10fd6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:11:46.837107 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25b6bb-d5f2-4cb6-a7db-333a3d10fd6e service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:46.837396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25b6bb-d5f2-4cb6-a7db-333a3d10fd6e service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:46.837679 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25b6bb-d5f2-4cb6-a7db-333a3d10fd6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:46.845692 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25b6bb-d5f2-4cb6-a7db-333a3d10fd6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:11:46.847321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25b6bb-d5f2-4cb6-a7db-333a3d10fd6e service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:11:46.856535 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 555/1130] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:11:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:11:47.733681 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2d73-f800-466b-a3d9-bc0a2275004d None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:47.734309 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2d73-f800-466b-a3d9-bc0a2275004d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:47.734309 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2d73-f800-466b-a3d9-bc0a2275004d None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:47.736157 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 576/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:11:47.741015 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0ed90-d21c-4ed6-8ec5-64e648c3737b None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:47.741474 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0ed90-d21c-4ed6-8ec5-64e648c3737b None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:47.741595 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0ed90-d21c-4ed6-8ec5-64e648c3737b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:47.760363 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-3db0ed90-d21c-4ed6-8ec5-64e648c3737b None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:11:47.761576 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-3db0ed90-d21c-4ed6-8ec5-64e648c3737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:11:47.769917 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 556/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:11:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:11:47.924901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2d73-f800-466b-a3d9-bc0a2275004d None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:11:47.938555 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2d73-f800-466b-a3d9-bc0a2275004d None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:11:47.943470 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60064fa8-92eb-49a8-a504-37b9fb1916d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:11:47.944134 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60064fa8-92eb-49a8-a504-37b9fb1916d5 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:47.944424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60064fa8-92eb-49a8-a504-37b9fb1916d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:47.944737 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60064fa8-92eb-49a8-a504-37b9fb1916d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:47.952857 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60064fa8-92eb-49a8-a504-37b9fb1916d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:11:47.954503 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60064fa8-92eb-49a8-a504-37b9fb1916d5 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:11:47.963850 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 577/1133] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:11:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:11:51.769779 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2e024-fbce-4738-ab7c-1f414013eb2a None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:51.770308 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2e024-fbce-4738-ab7c-1f414013eb2a None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:51.770308 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2e024-fbce-4738-ab7c-1f414013eb2a None None] PATH_INFO: `/v3` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:51.771597 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 557/1134] 10.222.0.50 () {54 vars in 925 bytes} [Mon Jun 6 07:11:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 06 07:11:51.777795 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949d48-1cab-44a9-86e3-8344cb0149b9 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:51.778248 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949d48-1cab-44a9-86e3-8344cb0149b9 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:51.778389 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949d48-1cab-44a9-86e3-8344cb0149b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:51.808785 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-7d949d48-1cab-44a9-86e3-8344cb0149b9 None None] MFA Rules not processed for user `33b6268131ad4545a07647d41b864f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:11:51.809983 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-7d949d48-1cab-44a9-86e3-8344cb0149b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:11:51.871913 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 578/1135] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Jun 6 07:11:51 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:11:56.169214 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd7ff3-31e7-4475-8636-ffe4dd4e6b7d None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:56.169709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd7ff3-31e7-4475-8636-ffe4dd4e6b7d None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:56.169832 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd7ff3-31e7-4475-8636-ffe4dd4e6b7d None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:56.171171 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 558/1136] 10.222.0.42 () {54 vars in 960 bytes} [Mon Jun 6 07:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:11:56.176638 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db1782-3803-4ab8-a359-f54629b137fc None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:56.177095 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db1782-3803-4ab8-a359-f54629b137fc None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:56.177204 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db1782-3803-4ab8-a359-f54629b137fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:56.194818 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-53db1782-3803-4ab8-a359-f54629b137fc None None] MFA Rules not processed for user `33b6268131ad4545a07647d41b864f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:11:56.196018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-53db1782-3803-4ab8-a359-f54629b137fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:11:56.204495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 579/1137] 10.222.0.42 () {58 vars in 1057 bytes} [Mon Jun 6 07:11:56 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:11:56.211767 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd7ff3-31e7-4475-8636-ffe4dd4e6b7d None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:11:56.225466 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd7ff3-31e7-4475-8636-ffe4dd4e6b7d None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:11:56.230559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df90477-7e69-4d12-9191-58c90834fdc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b6268131ad4545a07647d41b864f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:11:56.231193 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df90477-7e69-4d12-9191-58c90834fdc6 service placement] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:56.231480 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df90477-7e69-4d12-9191-58c90834fdc6 service placement] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:56.231760 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df90477-7e69-4d12-9191-58c90834fdc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:56.240829 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df90477-7e69-4d12-9191-58c90834fdc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:11:56.242430 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df90477-7e69-4d12-9191-58c90834fdc6 service placement] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:11:56.251877 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 559/1138] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:11:56 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:11:59.248089 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160e41a-01f6-4a9d-8d68-3d844ec74ba5 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:59.248655 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160e41a-01f6-4a9d-8d68-3d844ec74ba5 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:59.248655 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160e41a-01f6-4a9d-8d68-3d844ec74ba5 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:59.249978 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 580/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:11:59.255144 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8d7a-89fc-4918-9275-fe1e08aee7f5 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:59.255553 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8d7a-89fc-4918-9275-fe1e08aee7f5 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:59.255692 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8d7a-89fc-4918-9275-fe1e08aee7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:59.273771 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-627a8d7a-89fc-4918-9275-fe1e08aee7f5 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:11:59.274986 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-627a8d7a-89fc-4918-9275-fe1e08aee7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:11:59.282873 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 560/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:11:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:11:59.438278 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160e41a-01f6-4a9d-8d68-3d844ec74ba5 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:11:59.451727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160e41a-01f6-4a9d-8d68-3d844ec74ba5 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:11:59.457249 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391b7f2-2e26-44a4-8115-b8d4e1ac7079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:11:59.457889 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391b7f2-2e26-44a4-8115-b8d4e1ac7079 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:11:59.458177 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391b7f2-2e26-44a4-8115-b8d4e1ac7079 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:11:59.458495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391b7f2-2e26-44a4-8115-b8d4e1ac7079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:11:59.466584 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391b7f2-2e26-44a4-8115-b8d4e1ac7079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:11:59.468273 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391b7f2-2e26-44a4-8115-b8d4e1ac7079 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:11:59.478392 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 581/1141] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:11:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:12:00.360251 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863044-9e73-418e-a995-824a8c5f99c8 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:00.361325 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863044-9e73-418e-a995-824a8c5f99c8 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:00.361325 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3863044-9e73-418e-a995-824a8c5f99c8 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:00.362764 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 561/1142] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 6 07:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:12:00.367577 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06d73f-2027-401a-8f03-2846bd1f668d None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:00.368018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06d73f-2027-401a-8f03-2846bd1f668d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:00.368128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06d73f-2027-401a-8f03-2846bd1f668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:00.386570 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-8b06d73f-2027-401a-8f03-2846bd1f668d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:12:00.387766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-8b06d73f-2027-401a-8f03-2846bd1f668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:12:00.395591 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 582/1143] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 6 07:12:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:12:00.547052 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863044-9e73-418e-a995-824a8c5f99c8 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:12:00.561225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3863044-9e73-418e-a995-824a8c5f99c8 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:12:00.566194 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586aa76a-18b4-4e02-bf0c-0df008e1ea4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:12:00.566864 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586aa76a-18b4-4e02-bf0c-0df008e1ea4b service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:00.567153 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586aa76a-18b4-4e02-bf0c-0df008e1ea4b service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:00.567435 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586aa76a-18b4-4e02-bf0c-0df008e1ea4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:00.575541 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586aa76a-18b4-4e02-bf0c-0df008e1ea4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:12:00.577121 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586aa76a-18b4-4e02-bf0c-0df008e1ea4b service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:12:00.586437 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 562/1144] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:12:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:12:04.777860 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9f39a-2c35-4af1-9c52-0bd492653104 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:04.778565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9f39a-2c35-4af1-9c52-0bd492653104 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:04.778565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9f39a-2c35-4af1-9c52-0bd492653104 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:04.780010 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 583/1145] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:12:04.785303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f64134-5634-480c-9a1d-9bd5cb992366 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:04.785789 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f64134-5634-480c-9a1d-9bd5cb992366 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:04.785893 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f64134-5634-480c-9a1d-9bd5cb992366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:04.804170 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-04f64134-5634-480c-9a1d-9bd5cb992366 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:12:04.805374 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-04f64134-5634-480c-9a1d-9bd5cb992366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:12:04.813327 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 563/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:12:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:12:04.849872 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9f39a-2c35-4af1-9c52-0bd492653104 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:12:04.851556 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-27f9f39a-2c35-4af1-9c52-0bd492653104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:12:04.903165 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=100 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:12:04.908345 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9f39a-2c35-4af1-9c52-0bd492653104 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:12:04.911950 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f51eb-877b-486e-a0f6-e712b533bfe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:12:04.912600 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f51eb-877b-486e-a0f6-e712b533bfe8 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:04.912892 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f51eb-877b-486e-a0f6-e712b533bfe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:04.913177 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f51eb-877b-486e-a0f6-e712b533bfe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:04.922539 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f51eb-877b-486e-a0f6-e712b533bfe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:12:04.924557 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f51eb-877b-486e-a0f6-e712b533bfe8 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:12:04.934458 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 584/1147] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:12:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:12:07.222508 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b0df-1945-4464-a45b-d1becd274bc0 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:07.222933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b0df-1945-4464-a45b-d1becd274bc0 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:07.223082 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b0df-1945-4464-a45b-d1becd274bc0 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:07.224458 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 564/1148] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:12:07.229891 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254564d1-c831-4e02-8d79-44e5b1c2a955 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:07.232343 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254564d1-c831-4e02-8d79-44e5b1c2a955 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:07.232343 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254564d1-c831-4e02-8d79-44e5b1c2a955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:07.248685 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-254564d1-c831-4e02-8d79-44e5b1c2a955 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:12:07.249879 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-254564d1-c831-4e02-8d79-44e5b1c2a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:12:07.258228 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 585/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:12:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:12:07.295111 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b0df-1945-4464-a45b-d1becd274bc0 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:12:07.305858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b0df-1945-4464-a45b-d1becd274bc0 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:12:07.309424 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7e4d7-d9e4-4ae5-a27f-f92f0b54d587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:12:07.310061 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7e4d7-d9e4-4ae5-a27f-f92f0b54d587 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:07.310378 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7e4d7-d9e4-4ae5-a27f-f92f0b54d587 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:07.310671 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7e4d7-d9e4-4ae5-a27f-f92f0b54d587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:07.320167 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7e4d7-d9e4-4ae5-a27f-f92f0b54d587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:12:07.322158 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7e4d7-d9e4-4ae5-a27f-f92f0b54d587 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:12:07.331754 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 565/1150] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:12:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:12:11.216104 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37585a-1b47-4037-8219-b35d693fa92f None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:11.216638 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37585a-1b47-4037-8219-b35d693fa92f None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:11.216638 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37585a-1b47-4037-8219-b35d693fa92f None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:11.217959 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 586/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:12:11.223180 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a4971-d2b7-4660-afd5-8719bab2d218 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:11.223604 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a4971-d2b7-4660-afd5-8719bab2d218 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:11.223748 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a4971-d2b7-4660-afd5-8719bab2d218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:11.230047 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=60 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:12:11.241801 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-b88a4971-d2b7-4660-afd5-8719bab2d218 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:12:11.247355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-b88a4971-d2b7-4660-afd5-8719bab2d218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:12:11.250910 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 566/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:12:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:12:11.523231 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37585a-1b47-4037-8219-b35d693fa92f None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:12:11.524926 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-1b37585a-1b47-4037-8219-b35d693fa92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:12:11.583055 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37585a-1b47-4037-8219-b35d693fa92f None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:12:11.586593 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09005451-2b46-4f57-a7aa-273787dd8a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3429d0ba28474698c6c168270d314b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:12:11.587231 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09005451-2b46-4f57-a7aa-273787dd8a05 service cinder] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:11.587518 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09005451-2b46-4f57-a7aa-273787dd8a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:11.587799 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09005451-2b46-4f57-a7aa-273787dd8a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:11.596583 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09005451-2b46-4f57-a7aa-273787dd8a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:12:11.598019 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09005451-2b46-4f57-a7aa-273787dd8a05 service cinder] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:12:11.607244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 587/1153] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:12:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:12:13.920960 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44066c-f76c-47ac-97b6-59bfd034ecd9 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:13.921427 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44066c-f76c-47ac-97b6-59bfd034ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:13.921535 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44066c-f76c-47ac-97b6-59bfd034ecd9 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:13.922940 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 567/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 6 07:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:12:13.928734 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a18f64-2630-4fe8-851d-4fe93059a5a7 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:13.929180 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a18f64-2630-4fe8-851d-4fe93059a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:13.929297 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a18f64-2630-4fe8-851d-4fe93059a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:13.947826 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-e2a18f64-2630-4fe8-851d-4fe93059a5a7 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:12:13.949028 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-e2a18f64-2630-4fe8-851d-4fe93059a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:12:13.957401 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 588/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 6 07:12:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:12:14.227355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44066c-f76c-47ac-97b6-59bfd034ecd9 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:12:14.229012 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-1c44066c-f76c-47ac-97b6-59bfd034ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:12:14.242684 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44066c-f76c-47ac-97b6-59bfd034ecd9 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:12:14.246075 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed0888-874c-4c38-b12d-410d70c7b7b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3429d0ba28474698c6c168270d314b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:12:14.246746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0888-874c-4c38-b12d-410d70c7b7b9 service cinder] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:12:14.247032 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0888-874c-4c38-b12d-410d70c7b7b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:12:14.247307 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0888-874c-4c38-b12d-410d70c7b7b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:12:14.256022 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed0888-874c-4c38-b12d-410d70c7b7b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:12:14.257437 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed0888-874c-4c38-b12d-410d70c7b7b9 service cinder] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:12:14.266605 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 568/1156] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:12:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:12:23.942705 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=37 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:12:24.262575 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=8 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:13:32.919568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a34a4d-eecd-4e76-87ae-ef9735f9567b None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:32.920102 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a34a4d-eecd-4e76-87ae-ef9735f9567b None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:32.920102 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a34a4d-eecd-4e76-87ae-ef9735f9567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:32.932881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba20b-8357-4773-b684-278244cd9fb8 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:32.933427 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba20b-8357-4773-b684-278244cd9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:32.933427 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba20b-8357-4773-b684-278244cd9fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:32.937930 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-42a34a4d-eecd-4e76-87ae-ef9735f9567b None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:32.939163 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-42a34a4d-eecd-4e76-87ae-ef9735f9567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:32.947516 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 589/1157] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:13:32.952225 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-76cba20b-8357-4773-b684-278244cd9fb8 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:32.953414 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-76cba20b-8357-4773-b684-278244cd9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:32.955526 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593486-e672-4cac-9d5f-529da2cb83e4 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:32.955759 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593486-e672-4cac-9d5f-529da2cb83e4 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:32.956038 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593486-e672-4cac-9d5f-529da2cb83e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:32.961946 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 569/1158] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:13:32.969812 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2649ab-6ee2-4da7-b05a-0bbb87892fd7 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:32.970109 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2649ab-6ee2-4da7-b05a-0bbb87892fd7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:32.970503 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2649ab-6ee2-4da7-b05a-0bbb87892fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:32.974391 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-15593486-e672-4cac-9d5f-529da2cb83e4 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:32.975606 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-15593486-e672-4cac-9d5f-529da2cb83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:32.984330 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 590/1159] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:13:32.988748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15593486-e672-4cac-9d5f-529da2cb83e4 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:32.989669 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-fc2649ab-6ee2-4da7-b05a-0bbb87892fd7 None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:32.990899 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-fc2649ab-6ee2-4da7-b05a-0bbb87892fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:32.997646 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15593486-e672-4cac-9d5f-529da2cb83e4 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:32.998858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 570/1160] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:13:33.002253 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d072874-2ee8-43cf-9d42-2e48bb2197f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.002928 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d072874-2ee8-43cf-9d42-2e48bb2197f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.003059 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2649ab-6ee2-4da7-b05a-0bbb87892fd7 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.003215 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d072874-2ee8-43cf-9d42-2e48bb2197f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.003495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d072874-2ee8-43cf-9d42-2e48bb2197f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.004751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d072874-2ee8-43cf-9d42-2e48bb2197f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 07:13:33.005062 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d072874-2ee8-43cf-9d42-2e48bb2197f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.006695 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d072874-2ee8-43cf-9d42-2e48bb2197f1 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.012277 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2649ab-6ee2-4da7-b05a-0bbb87892fd7 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.017234 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.017869 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.018362 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.018499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 591/1161] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jun 6 07:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 07:13:33.018606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] PATH_INFO: `/v3/domains` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.019182 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 06 07:13:33.020056 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.021069 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WARNING py.warnings [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:13:33.021069 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: warnings.warn(msg) Jun 06 07:13:33.021069 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: Jun 06 07:13:33.021956 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.026648 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d072874-2ee8-43cf-9d42-2e48bb2197f1 admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.039712 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 571/1162] 10.222.0.42 () {58 vars in 1152 bytes} [Mon Jun 6 07:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 06 07:13:33.039883 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d072874-2ee8-43cf-9d42-2e48bb2197f1 admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.041259 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205cc7f-b2b0-4b11-9631-1131890dd718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.041588 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.041960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205cc7f-b2b0-4b11-9631-1131890dd718 admin admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.042186 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205cc7f-b2b0-4b11-9631-1131890dd718 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.042500 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205cc7f-b2b0-4b11-9631-1131890dd718 admin admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.043192 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205cc7f-b2b0-4b11-9631-1131890dd718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.044205 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING py.warnings [None req-a205cc7f-b2b0-4b11-9631-1131890dd718 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:13:33.044205 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: warnings.warn(msg) Jun 06 07:13:33.044205 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: Jun 06 07:13:33.045397 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205cc7f-b2b0-4b11-9631-1131890dd718 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.051537 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cb397-10ac-41a0-97b7-7abe5fc4b692 admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.056012 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b987d2b-51d1-4be1-a966-4c2b715b5cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.056641 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b987d2b-51d1-4be1-a966-4c2b715b5cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.056928 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b987d2b-51d1-4be1-a966-4c2b715b5cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.057208 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b987d2b-51d1-4be1-a966-4c2b715b5cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.057942 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b987d2b-51d1-4be1-a966-4c2b715b5cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.059838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b987d2b-51d1-4be1-a966-4c2b715b5cd1 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.153995 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 592/1163] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jun 6 07:13:33 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 07:13:33.158013 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205cc7f-b2b0-4b11-9631-1131890dd718 admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.165744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 572/1164] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jun 6 07:13:33 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 07:13:33.169653 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b987d2b-51d1-4be1-a966-4c2b715b5cd1 admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.220415 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205cc7f-b2b0-4b11-9631-1131890dd718 admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.240258 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b987d2b-51d1-4be1-a966-4c2b715b5cd1 admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.244888 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca07e20-f1b3-4c45-9f7b-7b4e9fb9266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.245564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca07e20-f1b3-4c45-9f7b-7b4e9fb9266d admin admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.245858 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca07e20-f1b3-4c45-9f7b-7b4e9fb9266d admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.246143 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca07e20-f1b3-4c45-9f7b-7b4e9fb9266d admin admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.246903 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca07e20-f1b3-4c45-9f7b-7b4e9fb9266d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.247918 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WARNING py.warnings [None req-9ca07e20-f1b3-4c45-9f7b-7b4e9fb9266d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:13:33.247918 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: warnings.warn(msg) Jun 06 07:13:33.247918 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: Jun 06 07:13:33.249134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca07e20-f1b3-4c45-9f7b-7b4e9fb9266d admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.276934 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeb6c1-a779-4d65-a630-d84fef0050ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.277597 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeb6c1-a779-4d65-a630-d84fef0050ce admin admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.278145 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeb6c1-a779-4d65-a630-d84fef0050ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.278456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeb6c1-a779-4d65-a630-d84fef0050ce admin admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.279147 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaeb6c1-a779-4d65-a630-d84fef0050ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.281091 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaeb6c1-a779-4d65-a630-d84fef0050ce admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.312192 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 573/1165] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jun 6 07:13:33 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 07:13:33.316839 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca07e20-f1b3-4c45-9f7b-7b4e9fb9266d admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.326569 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca07e20-f1b3-4c45-9f7b-7b4e9fb9266d admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.331404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbd157-f98d-46d7-abe1-14168cd93800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.332040 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbd157-f98d-46d7-abe1-14168cd93800 admin admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.332330 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbd157-f98d-46d7-abe1-14168cd93800 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.332611 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbd157-f98d-46d7-abe1-14168cd93800 admin admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.333359 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbd157-f98d-46d7-abe1-14168cd93800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.335009 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbd157-f98d-46d7-abe1-14168cd93800 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.346361 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 574/1166] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 07:13:33.348747 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbd157-f98d-46d7-abe1-14168cd93800 admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.349495 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 593/1167] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jun 6 07:13:33 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 07:13:33.354874 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeb6c1-a779-4d65-a630-d84fef0050ce admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.359535 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbd157-f98d-46d7-abe1-14168cd93800 admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.364954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043c46d-82dd-4f78-8654-b2a641f79642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.365092 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeb6c1-a779-4d65-a630-d84fef0050ce admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.365624 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043c46d-82dd-4f78-8654-b2a641f79642 admin admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.365909 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043c46d-82dd-4f78-8654-b2a641f79642 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.366216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043c46d-82dd-4f78-8654-b2a641f79642 admin admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.366975 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043c46d-82dd-4f78-8654-b2a641f79642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.368608 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043c46d-82dd-4f78-8654-b2a641f79642 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.369788 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f00f3-5e8e-4f4a-85fa-ed8c80e4c9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.370488 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f00f3-5e8e-4f4a-85fa-ed8c80e4c9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.370763 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f00f3-5e8e-4f4a-85fa-ed8c80e4c9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.371039 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f00f3-5e8e-4f4a-85fa-ed8c80e4c9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.371763 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f00f3-5e8e-4f4a-85fa-ed8c80e4c9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.373346 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f00f3-5e8e-4f4a-85fa-ed8c80e4c9b6 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.380269 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 575/1168] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 07:13:33.384285 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043c46d-82dd-4f78-8654-b2a641f79642 admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.387544 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 594/1169] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 07:13:33.393295 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f00f3-5e8e-4f4a-85fa-ed8c80e4c9b6 admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.394759 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043c46d-82dd-4f78-8654-b2a641f79642 admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.400531 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88cda6-2e98-4b3a-8952-b722fb4653dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.427964 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88cda6-2e98-4b3a-8952-b722fb4653dc admin admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.427964 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88cda6-2e98-4b3a-8952-b722fb4653dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.427964 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88cda6-2e98-4b3a-8952-b722fb4653dc admin admin] PATH_INFO: `/v3/projects/aabe41662e0240c1a9407d3042bc2330/users/eb8e78cfca424be49fe12af634309791/roles/030683e4ff8d4d1587d99164f75c0fb8` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.428301 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f00f3-5e8e-4f4a-85fa-ed8c80e4c9b6 admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.428301 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ff12-b145-4b7e-8382-77f99b182360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.428301 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ff12-b145-4b7e-8382-77f99b182360 admin admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.428301 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ff12-b145-4b7e-8382-77f99b182360 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.428651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ff12-b145-4b7e-8382-77f99b182360 admin admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.428651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ff12-b145-4b7e-8382-77f99b182360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.428651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ff12-b145-4b7e-8382-77f99b182360 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.428907 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88cda6-2e98-4b3a-8952-b722fb4653dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabe41662e0240c1a9407d3042bc2330, user_id=eb8e78cfca424be49fe12af634309791, role_id=030683e4ff8d4d1587d99164f75c0fb8)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.428907 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88cda6-2e98-4b3a-8952-b722fb4653dc admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.429063 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 595/1170] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 07:13:33.430660 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ff12-b145-4b7e-8382-77f99b182360 admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.440935 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ff12-b145-4b7e-8382-77f99b182360 admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.445638 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c7d96-a980-460c-9491-4cdb4fbe0c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.446584 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c7d96-a980-460c-9491-4cdb4fbe0c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.446897 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c7d96-a980-460c-9491-4cdb4fbe0c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.447229 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c7d96-a980-460c-9491-4cdb4fbe0c2c admin admin] PATH_INFO: `/v3/projects/6abd865155bd4f5a98a7ab41b228bc6c/users/0bdb5abd75984a39ad3efbc4a7838c31/roles/030683e4ff8d4d1587d99164f75c0fb8` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.461622 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c7d96-a980-460c-9491-4cdb4fbe0c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6abd865155bd4f5a98a7ab41b228bc6c, user_id=0bdb5abd75984a39ad3efbc4a7838c31, role_id=030683e4ff8d4d1587d99164f75c0fb8)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.462696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING py.warnings [None req-738c7d96-a980-460c-9491-4cdb4fbe0c2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:13:33.462696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: warnings.warn(msg) Jun 06 07:13:33.462696 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: Jun 06 07:13:33.464776 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c7d96-a980-460c-9491-4cdb4fbe0c2c admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.587624 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 576/1171] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jun 6 07:13:33 2022] PUT /identity/v3/projects/aabe41662e0240c1a9407d3042bc2330/users/eb8e78cfca424be49fe12af634309791/roles/030683e4ff8d4d1587d99164f75c0fb8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 07:13:33.592619 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0e60-b899-411a-ab9d-87062429009d None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.594196 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0e60-b899-411a-ab9d-87062429009d None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.594196 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0e60-b899-411a-ab9d-87062429009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.598838 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 596/1172] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jun 6 07:13:33 2022] PUT /identity/v3/projects/6abd865155bd4f5a98a7ab41b228bc6c/users/0bdb5abd75984a39ad3efbc4a7838c31/roles/030683e4ff8d4d1587d99164f75c0fb8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 07:13:33.603779 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80aa7-8dd1-429a-845d-38f3ebd7bb6d None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.604080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80aa7-8dd1-429a-845d-38f3ebd7bb6d None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.604368 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80aa7-8dd1-429a-845d-38f3ebd7bb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.609848 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:13:33.614820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-587e0e60-b899-411a-ab9d-87062429009d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:33.616027 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-587e0e60-b899-411a-ab9d-87062429009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:33.622155 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-b6a80aa7-8dd1-429a-845d-38f3ebd7bb6d None None] MFA Rules not processed for user `d63265941a9946a497001fc63bf2b23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:33.623395 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-b6a80aa7-8dd1-429a-845d-38f3ebd7bb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:33.666891 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:13:33.678963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 577/1173] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:13:33.689610 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 597/1174] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:13:33.692337 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e0e60-b899-411a-ab9d-87062429009d None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.693772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-587e0e60-b899-411a-ab9d-87062429009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:33.696902 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80aa7-8dd1-429a-845d-38f3ebd7bb6d None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:33.698195 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-b6a80aa7-8dd1-429a-845d-38f3ebd7bb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:33.751127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e0e60-b899-411a-ab9d-87062429009d None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.753672 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80aa7-8dd1-429a-845d-38f3ebd7bb6d None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:33.754838 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f066c3e-9a07-4bd3-907d-5b2e7b10482f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.755493 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f066c3e-9a07-4bd3-907d-5b2e7b10482f service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.755791 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f066c3e-9a07-4bd3-907d-5b2e7b10482f service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.756079 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f066c3e-9a07-4bd3-907d-5b2e7b10482f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.757342 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156b26-7e8f-4e4a-b912-55fddc7fa8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:33.757985 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156b26-7e8f-4e4a-b912-55fddc7fa8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:33.758269 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156b26-7e8f-4e4a-b912-55fddc7fa8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:33.758575 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156b26-7e8f-4e4a-b912-55fddc7fa8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:33.765470 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f066c3e-9a07-4bd3-907d-5b2e7b10482f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.766945 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f066c3e-9a07-4bd3-907d-5b2e7b10482f service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.767413 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae156b26-7e8f-4e4a-b912-55fddc7fa8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:33.768944 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae156b26-7e8f-4e4a-b912-55fddc7fa8b5 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:33.776687 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 578/1175] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:13:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:13:33.778938 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 598/1176] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:13:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:13:39.877982 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78abbfd-12a3-487c-a17c-78598e1cef16 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:39.878526 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78abbfd-12a3-487c-a17c-78598e1cef16 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:39.879018 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78abbfd-12a3-487c-a17c-78598e1cef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:39.921021 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-d78abbfd-12a3-487c-a17c-78598e1cef16 None None] MFA Rules not processed for user `0bdb5abd75984a39ad3efbc4a7838c31`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:39.923559 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-d78abbfd-12a3-487c-a17c-78598e1cef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:40.031812 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 579/1177] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:39 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:13:40.032984 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156b26-7e8f-4e4a-b912-55fddc7fa8b5 service neutron] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.045163 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156b26-7e8f-4e4a-b912-55fddc7fa8b5 service neutron] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.052962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d87f63-9551-47df-bada-ea547df854c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.053655 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87f63-9551-47df-bada-ea547df854c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.057064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87f63-9551-47df-bada-ea547df854c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.057064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87f63-9551-47df-bada-ea547df854c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.057064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d87f63-9551-47df-bada-ea547df854c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.057064 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d87f63-9551-47df-bada-ea547df854c0 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.196111 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 599/1178] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jun 6 07:13:40 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 07:13:40.203953 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78abbfd-12a3-487c-a17c-78598e1cef16 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.215288 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78abbfd-12a3-487c-a17c-78598e1cef16 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.234508 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee512d3-a73b-443e-a100-325b246371a7 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.234508 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee512d3-a73b-443e-a100-325b246371a7 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.234508 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee512d3-a73b-443e-a100-325b246371a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.285974 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-0ee512d3-a73b-443e-a100-325b246371a7 None None] MFA Rules not processed for user `eb8e78cfca424be49fe12af634309791`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:40.286424 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-0ee512d3-a73b-443e-a100-325b246371a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:40.309368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e82be-73da-4095-a082-440b002a3e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.310055 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e82be-73da-4095-a082-440b002a3e1e admin admin] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.310700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e82be-73da-4095-a082-440b002a3e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.310700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e82be-73da-4095-a082-440b002a3e1e admin admin] PATH_INFO: `/v3/users` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.311423 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e82be-73da-4095-a082-440b002a3e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.313365 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e82be-73da-4095-a082-440b002a3e1e admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.375101 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 600/1179] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:40 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:13:40.381186 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee512d3-a73b-443e-a100-325b246371a7 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.390693 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee512d3-a73b-443e-a100-325b246371a7 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.396319 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70677ff1-68c3-423f-a8ec-bada72b31d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.397018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70677ff1-68c3-423f-a8ec-bada72b31d7c admin admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.398490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70677ff1-68c3-423f-a8ec-bada72b31d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.398490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70677ff1-68c3-423f-a8ec-bada72b31d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.398490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70677ff1-68c3-423f-a8ec-bada72b31d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.400252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70677ff1-68c3-423f-a8ec-bada72b31d7c admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.410939 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:13:40.417795 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 580/1180] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jun 6 07:13:40 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 07:13:40.421872 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e82be-73da-4095-a082-440b002a3e1e admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.432393 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e82be-73da-4095-a082-440b002a3e1e admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.437058 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4697-432b-4ab0-b4f6-36b03bec8f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.437716 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4697-432b-4ab0-b4f6-36b03bec8f31 admin admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.438005 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4697-432b-4ab0-b4f6-36b03bec8f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.438288 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4697-432b-4ab0-b4f6-36b03bec8f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.439101 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e4697-432b-4ab0-b4f6-36b03bec8f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.440846 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e4697-432b-4ab0-b4f6-36b03bec8f31 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.454024 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 581/1181] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 07:13:40.458772 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4697-432b-4ab0-b4f6-36b03bec8f31 admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.469301 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4697-432b-4ab0-b4f6-36b03bec8f31 admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.474661 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80f820-dd01-4795-98dc-30f739d6bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.475623 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80f820-dd01-4795-98dc-30f739d6bcbf admin admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.475916 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80f820-dd01-4795-98dc-30f739d6bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.476204 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80f820-dd01-4795-98dc-30f739d6bcbf admin admin] PATH_INFO: `/v3/projects/9fb845e099ed4e8d97a387064b275cb6/users/eb3d815d4fae4b75b6745999ceb85b05/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.478724 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:13:40.492177 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80f820-dd01-4795-98dc-30f739d6bcbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb845e099ed4e8d97a387064b275cb6, user_id=eb3d815d4fae4b75b6745999ceb85b05, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.495355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80f820-dd01-4795-98dc-30f739d6bcbf admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.497726 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 601/1182] 10.222.0.42 () {60 vars in 1152 bytes} [Mon Jun 6 07:13:40 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 06 07:13:40.501845 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70677ff1-68c3-423f-a8ec-bada72b31d7c admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.571071 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70677ff1-68c3-423f-a8ec-bada72b31d7c admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.576376 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3371aba-11af-4a90-a1af-c2eb3ee52b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.577234 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3371aba-11af-4a90-a1af-c2eb3ee52b43 admin admin] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.577929 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3371aba-11af-4a90-a1af-c2eb3ee52b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.577929 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3371aba-11af-4a90-a1af-c2eb3ee52b43 admin admin] PATH_INFO: `/v3/users` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.578537 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3371aba-11af-4a90-a1af-c2eb3ee52b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.580802 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3371aba-11af-4a90-a1af-c2eb3ee52b43 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.595583 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 582/1183] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jun 6 07:13:40 2022] PUT /identity/v3/projects/9fb845e099ed4e8d97a387064b275cb6/users/eb3d815d4fae4b75b6745999ceb85b05/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 07:13:40.599626 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80f820-dd01-4795-98dc-30f739d6bcbf admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.656645 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 602/1184] 10.222.0.42 () {60 vars in 1143 bytes} [Mon Jun 6 07:13:40 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 06 07:13:40.660311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3371aba-11af-4a90-a1af-c2eb3ee52b43 admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.670516 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3371aba-11af-4a90-a1af-c2eb3ee52b43 admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.672357 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80f820-dd01-4795-98dc-30f739d6bcbf admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.677465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbfac-f16f-4f22-b9b0-5c4d4b87777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.678066 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbfac-f16f-4f22-b9b0-5c4d4b87777b admin admin] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.678428 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5760fc6-4441-4a83-bf42-eea4c5e14149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.678553 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbfac-f16f-4f22-b9b0-5c4d4b87777b admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.679359 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbfac-f16f-4f22-b9b0-5c4d4b87777b admin admin] PATH_INFO: `/v3/roles` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.679637 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5760fc6-4441-4a83-bf42-eea4c5e14149 admin admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.679755 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abbfac-f16f-4f22-b9b0-5c4d4b87777b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.679951 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5760fc6-4441-4a83-bf42-eea4c5e14149 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.679951 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5760fc6-4441-4a83-bf42-eea4c5e14149 admin admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.680653 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5760fc6-4441-4a83-bf42-eea4c5e14149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.682321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5760fc6-4441-4a83-bf42-eea4c5e14149 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.685116 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abbfac-f16f-4f22-b9b0-5c4d4b87777b admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.696135 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 583/1185] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 07:13:40.700028 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5760fc6-4441-4a83-bf42-eea4c5e14149 admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.703140 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 603/1186] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 06 07:13:40.716361 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5760fc6-4441-4a83-bf42-eea4c5e14149 admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.720270 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbfac-f16f-4f22-b9b0-5c4d4b87777b admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.722021 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b642ac-e633-468a-bea9-6aae702d97c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.723011 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b642ac-e633-468a-bea9-6aae702d97c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.723306 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b642ac-e633-468a-bea9-6aae702d97c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.723593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b642ac-e633-468a-bea9-6aae702d97c9 admin admin] PATH_INFO: `/v3/projects/9fb845e099ed4e8d97a387064b275cb6/users/eb3d815d4fae4b75b6745999ceb85b05/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.725709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b642ac-e633-468a-bea9-6aae702d97c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb845e099ed4e8d97a387064b275cb6, user_id=eb3d815d4fae4b75b6745999ceb85b05, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.728564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b642ac-e633-468a-bea9-6aae702d97c9 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.736453 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbfac-f16f-4f22-b9b0-5c4d4b87777b admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:40.741112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 584/1187] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jun 6 07:13:40 2022] PUT /identity/v3/projects/9fb845e099ed4e8d97a387064b275cb6/users/eb3d815d4fae4b75b6745999ceb85b05/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 07:13:40.815989 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e787d-4ee0-4129-9e69-f5bfaaf8cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:40.817546 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e787d-4ee0-4129-9e69-f5bfaaf8cf30 admin admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:40.817893 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e787d-4ee0-4129-9e69-f5bfaaf8cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:40.818252 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e787d-4ee0-4129-9e69-f5bfaaf8cf30 admin admin] PATH_INFO: `/v3/projects/5472ad1e394d4d16a94e5b3ec2ba59b1/users/0d295ad58ec44a20bb1778f7bfed6de4/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:40.835403 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e787d-4ee0-4129-9e69-f5bfaaf8cf30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5472ad1e394d4d16a94e5b3ec2ba59b1, user_id=0d295ad58ec44a20bb1778f7bfed6de4, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:40.841812 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e787d-4ee0-4129-9e69-f5bfaaf8cf30 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:40.923311 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 604/1188] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jun 6 07:13:40 2022] PUT /identity/v3/projects/5472ad1e394d4d16a94e5b3ec2ba59b1/users/0d295ad58ec44a20bb1778f7bfed6de4/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 07:13:40.924094 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b642ac-e633-468a-bea9-6aae702d97c9 admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:40.949613 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b642ac-e633-468a-bea9-6aae702d97c9 admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:41.052377 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1372a-8c84-49a8-9a30-9d50871e047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:41.053278 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1372a-8c84-49a8-9a30-9d50871e047a admin admin] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:41.053397 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1372a-8c84-49a8-9a30-9d50871e047a admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:41.053740 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1372a-8c84-49a8-9a30-9d50871e047a admin admin] PATH_INFO: `/v3/roles` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:41.054560 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1372a-8c84-49a8-9a30-9d50871e047a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:41.056164 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1372a-8c84-49a8-9a30-9d50871e047a admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:41.085831 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 585/1189] 10.222.0.42 () {58 vars in 1121 bytes} [Mon Jun 6 07:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 06 07:13:41.092816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e787d-4ee0-4129-9e69-f5bfaaf8cf30 admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:41.103815 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e787d-4ee0-4129-9e69-f5bfaaf8cf30 admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:41.119758 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a1add-cace-4ee3-8d4e-69c8e677864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:41.128241 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a1add-cace-4ee3-8d4e-69c8e677864f admin admin] REQUEST_METHOD: `PUT` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:41.128241 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a1add-cace-4ee3-8d4e-69c8e677864f admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:41.128241 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a1add-cace-4ee3-8d4e-69c8e677864f admin admin] PATH_INFO: `/v3/projects/5472ad1e394d4d16a94e5b3ec2ba59b1/users/0d295ad58ec44a20bb1778f7bfed6de4/roles/7e6b1b3c63c9411fb0e9bdbab192bbac` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:41.128241 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a1add-cace-4ee3-8d4e-69c8e677864f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5472ad1e394d4d16a94e5b3ec2ba59b1, user_id=0d295ad58ec44a20bb1778f7bfed6de4, role_id=7e6b1b3c63c9411fb0e9bdbab192bbac)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:41.128241 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a1add-cace-4ee3-8d4e-69c8e677864f admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:41.142685 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 605/1190] 10.222.0.42 () {60 vars in 1482 bytes} [Mon Jun 6 07:13:41 2022] PUT /identity/v3/projects/5472ad1e394d4d16a94e5b3ec2ba59b1/users/0d295ad58ec44a20bb1778f7bfed6de4/roles/7e6b1b3c63c9411fb0e9bdbab192bbac => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:13:47.911754 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666400c-4931-48f1-a296-5a96ce5f6dbf None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:47.912304 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666400c-4931-48f1-a296-5a96ce5f6dbf None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:47.930551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666400c-4931-48f1-a296-5a96ce5f6dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:47.970321 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-0666400c-4931-48f1-a296-5a96ce5f6dbf None None] MFA Rules not processed for user `eb3d815d4fae4b75b6745999ceb85b05`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:47.976602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-0666400c-4931-48f1-a296-5a96ce5f6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:48.114475 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:13:48.146478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 586/1191] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:47 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:13:48.162812 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a1add-cace-4ee3-8d4e-69c8e677864f admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:48.164830 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-bc2a1add-cace-4ee3-8d4e-69c8e677864f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:48.252058 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a1ce-1ae9-47fe-8b73-f6c7f5752438 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:48.252376 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a1ce-1ae9-47fe-8b73-f6c7f5752438 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:48.252654 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a1ce-1ae9-47fe-8b73-f6c7f5752438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:48.261891 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:13:48.296455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a1add-cace-4ee3-8d4e-69c8e677864f admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:48.300357 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-4cf5a1ce-1ae9-47fe-8b73-f6c7f5752438 None None] MFA Rules not processed for user `0d295ad58ec44a20bb1778f7bfed6de4`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:48.302302 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-4cf5a1ce-1ae9-47fe-8b73-f6c7f5752438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:48.327366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42305a-ea4b-4170-874d-7d9b01682a0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1618d2efb0c45f98a081126f5342abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:48.329069 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42305a-ea4b-4170-874d-7d9b01682a0b service glance] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:48.329456 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42305a-ea4b-4170-874d-7d9b01682a0b service glance] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:48.329627 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42305a-ea4b-4170-874d-7d9b01682a0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:48.462183 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42305a-ea4b-4170-874d-7d9b01682a0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:48.465079 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42305a-ea4b-4170-874d-7d9b01682a0b service glance] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:48.478737 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 587/1192] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:48 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:13:48.487600 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 606/1193] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:13:48 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:13:48.494814 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5a1ce-1ae9-47fe-8b73-f6c7f5752438 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:48.497189 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-4cf5a1ce-1ae9-47fe-8b73-f6c7f5752438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:48.518604 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5a1ce-1ae9-47fe-8b73-f6c7f5752438 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:48.523484 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dd586-853a-4795-8cff-517011025b69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1618d2efb0c45f98a081126f5342abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:48.524214 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dd586-853a-4795-8cff-517011025b69 service glance] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:48.529640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dd586-853a-4795-8cff-517011025b69 service glance] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:48.529640 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dd586-853a-4795-8cff-517011025b69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:48.612337 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dd586-853a-4795-8cff-517011025b69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:48.613735 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dd586-853a-4795-8cff-517011025b69 service glance] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:48.631677 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 588/1194] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:13:48 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 07:13:58.232973 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92feae8-5444-4f05-8b7e-4f5e3f23a258 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:58.233661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92feae8-5444-4f05-8b7e-4f5e3f23a258 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:58.236152 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92feae8-5444-4f05-8b7e-4f5e3f23a258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:58.265476 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-b92feae8-5444-4f05-8b7e-4f5e3f23a258 None None] MFA Rules not processed for user `eb8e78cfca424be49fe12af634309791`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:58.268128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-b92feae8-5444-4f05-8b7e-4f5e3f23a258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:58.281116 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 607/1195] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:13:58 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:13:58.612860 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91271ba7-1cc7-4a8b-8b30-112230810163 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:58.614140 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91271ba7-1cc7-4a8b-8b30-112230810163 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:58.614140 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91271ba7-1cc7-4a8b-8b30-112230810163 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:58.615660 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 589/1196] 10.222.0.42 () {54 vars in 961 bytes} [Mon Jun 6 07:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:13:58.621137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=68 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:13:58.624676 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b4976-4ae8-4d43-b76f-be1802a71d02 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:58.624966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b4976-4ae8-4d43-b76f-be1802a71d02 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:58.625211 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b4976-4ae8-4d43-b76f-be1802a71d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:58.646860 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-b19b4976-4ae8-4d43-b76f-be1802a71d02 None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:58.648159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-b19b4976-4ae8-4d43-b76f-be1802a71d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:58.714704 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 608/1197] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Jun 6 07:13:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:13:58.720464 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e5fe0-5960-4084-8132-a660090296b5 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:58.720758 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e5fe0-5960-4084-8132-a660090296b5 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:58.721036 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e5fe0-5960-4084-8132-a660090296b5 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:58.722725 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 590/1198] 10.222.0.42 () {54 vars in 912 bytes} [Mon Jun 6 07:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:13:58.727923 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716b848-9419-4119-a78a-d603bd1f709e None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:58.728221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716b848-9419-4119-a78a-d603bd1f709e None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:58.728520 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716b848-9419-4119-a78a-d603bd1f709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:58.749733 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-5716b848-9419-4119-a78a-d603bd1f709e None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:58.751074 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-5716b848-9419-4119-a78a-d603bd1f709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:58.761766 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 609/1199] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jun 6 07:13:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:13:58.774709 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e5fe0-5960-4084-8132-a660090296b5 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:58.786920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e5fe0-5960-4084-8132-a660090296b5 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:58.792925 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c735013-611b-43de-8377-8e4c9ecd649f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1618d2efb0c45f98a081126f5342abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:58.793948 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735013-611b-43de-8377-8e4c9ecd649f service glance] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:58.794613 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735013-611b-43de-8377-8e4c9ecd649f service glance] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:58.802390 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735013-611b-43de-8377-8e4c9ecd649f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:58.805530 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c735013-611b-43de-8377-8e4c9ecd649f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:58.807074 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c735013-611b-43de-8377-8e4c9ecd649f service glance] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:58.817944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 591/1200] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:13:58 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:13:59.215386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f217e-c943-46f7-86b2-5819ab5885f4 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.216077 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f217e-c943-46f7-86b2-5819ab5885f4 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.216597 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f217e-c943-46f7-86b2-5819ab5885f4 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.218140 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 610/1201] 10.222.0.42 () {54 vars in 912 bytes} [Mon Jun 6 07:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:13:59.223916 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2d4d5-f6bb-4928-b23b-f8798dac22ba None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.224216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2d4d5-f6bb-4928-b23b-f8798dac22ba None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.224502 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2d4d5-f6bb-4928-b23b-f8798dac22ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.248757 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-dbb2d4d5-f6bb-4928-b23b-f8798dac22ba None None] MFA Rules not processed for user `77904d1264284c29b2d0b73831dd4096`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:59.250067 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-dbb2d4d5-f6bb-4928-b23b-f8798dac22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:59.327478 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 592/1202] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jun 6 07:13:59 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:13:59.339081 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f217e-c943-46f7-86b2-5819ab5885f4 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:59.359157 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f217e-c943-46f7-86b2-5819ab5885f4 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:59.359157 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bc74e-0d9b-4928-a527-5d55e53a2597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:59.359157 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bc74e-0d9b-4928-a527-5d55e53a2597 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.359157 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bc74e-0d9b-4928-a527-5d55e53a2597 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.359595 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bc74e-0d9b-4928-a527-5d55e53a2597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.364566 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bc74e-0d9b-4928-a527-5d55e53a2597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:59.366105 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bc74e-0d9b-4928-a527-5d55e53a2597 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:13:59.376066 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 611/1203] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:13:59 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 07:13:59.855649 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34f5f-bdf5-4a92-ab17-df1a7a7de7e6 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.856118 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34f5f-bdf5-4a92-ab17-df1a7a7de7e6 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.856224 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34f5f-bdf5-4a92-ab17-df1a7a7de7e6 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.857574 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 593/1204] 10.222.0.42 () {54 vars in 961 bytes} [Mon Jun 6 07:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:13:59.863429 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bcf22-578e-42f7-9f5d-bced368d98e1 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.863800 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bcf22-578e-42f7-9f5d-bced368d98e1 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.864121 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bcf22-578e-42f7-9f5d-bced368d98e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.875222 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec345-5f54-43be-98a5-a1df3e0873f7 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.875625 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec345-5f54-43be-98a5-a1df3e0873f7 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.876015 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec345-5f54-43be-98a5-a1df3e0873f7 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.878308 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 594/1205] 10.222.0.42 () {54 vars in 960 bytes} [Mon Jun 6 07:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 07:13:59.883227 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-ba0bcf22-578e-42f7-9f5d-bced368d98e1 None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:59.884441 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-ba0bcf22-578e-42f7-9f5d-bced368d98e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:59.884571 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5626-bc16-470b-aeb3-d6e404aae874 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.884916 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5626-bc16-470b-aeb3-d6e404aae874 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.885303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5626-bc16-470b-aeb3-d6e404aae874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.895127 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 612/1206] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Jun 6 07:13:59 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:13:59.900656 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422277-7493-4a78-a2eb-a295264094e8 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.900947 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422277-7493-4a78-a2eb-a295264094e8 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.901231 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c422277-7493-4a78-a2eb-a295264094e8 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.902895 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 613/1207] 10.222.0.42 () {54 vars in 912 bytes} [Mon Jun 6 07:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 06 07:13:59.906176 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-936c5626-bc16-470b-aeb3-d6e404aae874 None None] MFA Rules not processed for user `33b6268131ad4545a07647d41b864f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:59.907501 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c554b-fd41-422c-b0d3-1861d50a7f46 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.907643 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-936c5626-bc16-470b-aeb3-d6e404aae874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:59.908493 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c554b-fd41-422c-b0d3-1861d50a7f46 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.908950 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c554b-fd41-422c-b0d3-1861d50a7f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.930885 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-3d4c554b-fd41-422c-b0d3-1861d50a7f46 None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:13:59.932651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-3d4c554b-fd41-422c-b0d3-1861d50a7f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:13:59.943379 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 614/1208] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jun 6 07:13:59 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:13:59.955066 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c554b-fd41-422c-b0d3-1861d50a7f46 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:13:59.967379 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c554b-fd41-422c-b0d3-1861d50a7f46 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:13:59.973076 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397fccb-1ca7-4263-8a7e-5b0116663812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:13:59.974511 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397fccb-1ca7-4263-8a7e-5b0116663812 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:13:59.974816 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397fccb-1ca7-4263-8a7e-5b0116663812 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:13:59.975106 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397fccb-1ca7-4263-8a7e-5b0116663812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:13:59.987487 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397fccb-1ca7-4263-8a7e-5b0116663812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:13:59.988972 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397fccb-1ca7-4263-8a7e-5b0116663812 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:14:00.000392 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 595/1209] 10.222.0.42 () {58 vars in 1057 bytes} [Mon Jun 6 07:13:59 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:14:00.001371 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 615/1210] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:13:59 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 06 07:14:00.011495 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5626-bc16-470b-aeb3-d6e404aae874 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:14:00.024819 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5626-bc16-470b-aeb3-d6e404aae874 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:14:00.031127 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3163f-2d88-4eba-86b3-68d7eaeea77f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b6268131ad4545a07647d41b864f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:14:00.031884 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3163f-2d88-4eba-86b3-68d7eaeea77f service placement] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:00.032241 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3163f-2d88-4eba-86b3-68d7eaeea77f service placement] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:00.032522 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3163f-2d88-4eba-86b3-68d7eaeea77f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:00.034509 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-d8f3163f-2d88-4eba-86b3-68d7eaeea77f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:14:00.057030 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3163f-2d88-4eba-86b3-68d7eaeea77f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:14:00.058790 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3163f-2d88-4eba-86b3-68d7eaeea77f service placement] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:14:00.078076 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 596/1211] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:14:00 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:14:09.995415 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=83 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:14:10.065276 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=64 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:14:10.566061 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed78c-d651-46d7-a12e-b5a5df3e3454 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:10.566390 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed78c-d651-46d7-a12e-b5a5df3e3454 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:10.566683 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed78c-d651-46d7-a12e-b5a5df3e3454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:10.585932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-e0aed78c-d651-46d7-a12e-b5a5df3e3454 None None] MFA Rules not processed for user `77904d1264284c29b2d0b73831dd4096`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:14:10.587173 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-e0aed78c-d651-46d7-a12e-b5a5df3e3454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:14:10.593659 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 616/1212] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Jun 6 07:14:10 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:14:10.605303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3163f-2d88-4eba-86b3-68d7eaeea77f service placement] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:14:10.616642 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3163f-2d88-4eba-86b3-68d7eaeea77f service placement] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:14:10.620365 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc04ae6-ebc4-4f0d-871e-37d05e8208f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:14:10.621018 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04ae6-ebc4-4f0d-871e-37d05e8208f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:10.621303 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04ae6-ebc4-4f0d-871e-37d05e8208f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:10.621578 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04ae6-ebc4-4f0d-871e-37d05e8208f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:10.629954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc04ae6-ebc4-4f0d-871e-37d05e8208f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:14:10.631418 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc04ae6-ebc4-4f0d-871e-37d05e8208f4 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:14:10.639686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 597/1213] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:14:10 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:14:11.631565 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba046a-b074-414a-8f5f-43edcacae506 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:11.632154 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba046a-b074-414a-8f5f-43edcacae506 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:11.632620 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba046a-b074-414a-8f5f-43edcacae506 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:11.634548 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 617/1214] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jun 6 07:14:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:14:11.646092 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0afb4-755a-400f-a7c7-20629db812b8 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:11.646689 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0afb4-755a-400f-a7c7-20629db812b8 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:11.649868 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0afb4-755a-400f-a7c7-20629db812b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:11.674964 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-b4b0afb4-755a-400f-a7c7-20629db812b8 None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:14:11.676781 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-b4b0afb4-755a-400f-a7c7-20629db812b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:14:11.686954 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 598/1215] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jun 6 07:14:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:14:11.718592 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba046a-b074-414a-8f5f-43edcacae506 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:14:11.729920 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba046a-b074-414a-8f5f-43edcacae506 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:14:11.736494 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a14a30-092a-489b-8d5c-ef3ad2772a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:14:11.737169 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a14a30-092a-489b-8d5c-ef3ad2772a07 service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:11.737464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a14a30-092a-489b-8d5c-ef3ad2772a07 service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:11.737749 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a14a30-092a-489b-8d5c-ef3ad2772a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:11.748915 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a14a30-092a-489b-8d5c-ef3ad2772a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:14:11.750618 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a14a30-092a-489b-8d5c-ef3ad2772a07 service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:14:11.762569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 618/1216] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:14:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:14:18.285524 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e1920-ef3d-4e7f-a14b-033ea7f49494 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:18.286090 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e1920-ef3d-4e7f-a14b-033ea7f49494 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:18.286090 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e1920-ef3d-4e7f-a14b-033ea7f49494 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:18.288672 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 599/1217] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jun 6 07:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:14:18.301879 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec65e3-894e-46c2-99e3-8635bcd8cc16 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:18.302427 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec65e3-894e-46c2-99e3-8635bcd8cc16 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:18.302653 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec65e3-894e-46c2-99e3-8635bcd8cc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:18.321377 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-9fec65e3-894e-46c2-99e3-8635bcd8cc16 None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:14:18.322710 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-9fec65e3-894e-46c2-99e3-8635bcd8cc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:14:18.331803 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 619/1218] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jun 6 07:14:18 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:14:18.346984 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e1920-ef3d-4e7f-a14b-033ea7f49494 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:14:18.362483 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e1920-ef3d-4e7f-a14b-033ea7f49494 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:14:18.369238 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a7f0d-c3a6-4d28-9fe2-26dc765d5fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:14:18.370564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a7f0d-c3a6-4d28-9fe2-26dc765d5fc4 service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:18.370564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a7f0d-c3a6-4d28-9fe2-26dc765d5fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:18.370564 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a7f0d-c3a6-4d28-9fe2-26dc765d5fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:18.382222 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a7f0d-c3a6-4d28-9fe2-26dc765d5fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:14:18.383871 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a7f0d-c3a6-4d28-9fe2-26dc765d5fc4 service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:14:18.395134 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 600/1219] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:14:18 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:14:28.315641 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=12 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:14:28.390524 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=15 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:14:31.919066 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec65e3-894e-46c2-99e3-8635bcd8cc16 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:14:31.931183 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec65e3-894e-46c2-99e3-8635bcd8cc16 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:14:31.935066 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c89604-fd8d-4f7e-8ac4-7c15556b2037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:14:31.935912 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c89604-fd8d-4f7e-8ac4-7c15556b2037 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:14:31.936202 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c89604-fd8d-4f7e-8ac4-7c15556b2037 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:14:31.936490 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c89604-fd8d-4f7e-8ac4-7c15556b2037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:14:31.951692 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c89604-fd8d-4f7e-8ac4-7c15556b2037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:14:31.951692 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c89604-fd8d-4f7e-8ac4-7c15556b2037 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:14:31.960389 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 620/1220] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:14:31 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:14:41.955049 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=6 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:15:47.134315 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61052b-ccd4-4598-b6d7-8dfbfa8f3881 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:15:47.134881 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61052b-ccd4-4598-b6d7-8dfbfa8f3881 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:15:47.134977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61052b-ccd4-4598-b6d7-8dfbfa8f3881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:15:47.161777 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-3d61052b-ccd4-4598-b6d7-8dfbfa8f3881 None None] MFA Rules not processed for user `0bdb5abd75984a39ad3efbc4a7838c31`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:15:47.163304 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-3d61052b-ccd4-4598-b6d7-8dfbfa8f3881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:15:47.189863 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 601/1221] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:15:47 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:15:56.277517 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d6cfe-fc1d-407b-8435-612073218802 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:15:56.277925 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d6cfe-fc1d-407b-8435-612073218802 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:15:56.278128 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d6cfe-fc1d-407b-8435-612073218802 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:15:56.280190 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 621/1222] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jun 6 07:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:15:56.317062 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1dca0-5692-4a2a-a2f0-40079c640ece None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:15:56.317562 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1dca0-5692-4a2a-a2f0-40079c640ece None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:15:56.317646 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1dca0-5692-4a2a-a2f0-40079c640ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:15:56.345180 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-2cb1dca0-5692-4a2a-a2f0-40079c640ece None None] MFA Rules not processed for user `33b6268131ad4545a07647d41b864f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:15:56.346489 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-2cb1dca0-5692-4a2a-a2f0-40079c640ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:15:56.369100 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 602/1223] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jun 6 07:15:56 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:15:56.380364 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d6cfe-fc1d-407b-8435-612073218802 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:15:56.393567 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d6cfe-fc1d-407b-8435-612073218802 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:15:56.399596 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb11622-8975-45df-a510-f9125bfdd29a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b6268131ad4545a07647d41b864f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:15:56.400265 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11622-8975-45df-a510-f9125bfdd29a service placement] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:15:56.400558 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11622-8975-45df-a510-f9125bfdd29a service placement] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:15:56.400840 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11622-8975-45df-a510-f9125bfdd29a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:15:56.410947 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb11622-8975-45df-a510-f9125bfdd29a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:15:56.412928 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb11622-8975-45df-a510-f9125bfdd29a service placement] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:15:56.425093 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 622/1224] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:15:56 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:16:00.304010 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533a31-51ef-4e39-bec6-dbc92adcb687 None None] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:00.304540 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533a31-51ef-4e39-bec6-dbc92adcb687 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:00.304645 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533a31-51ef-4e39-bec6-dbc92adcb687 None None] PATH_INFO: `/` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:00.305994 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 603/1225] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jun 6 07:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:16:00.318087 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92176f4-a54e-4078-9ab8-bb8373904318 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:00.318729 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92176f4-a54e-4078-9ab8-bb8373904318 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:00.318864 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92176f4-a54e-4078-9ab8-bb8373904318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:00.337654 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-f92176f4-a54e-4078-9ab8-bb8373904318 None None] MFA Rules not processed for user `33b6268131ad4545a07647d41b864f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:16:00.338962 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-f92176f4-a54e-4078-9ab8-bb8373904318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:16:00.347732 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 623/1226] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jun 6 07:16:00 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:16:00.360952 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf533a31-51ef-4e39-bec6-dbc92adcb687 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:16:00.374703 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf533a31-51ef-4e39-bec6-dbc92adcb687 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:16:00.380265 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3f6f0-92a4-4c05-bf31-46129b5e3177 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b6268131ad4545a07647d41b864f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:16:00.380920 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3f6f0-92a4-4c05-bf31-46129b5e3177 service placement] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:00.381217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3f6f0-92a4-4c05-bf31-46129b5e3177 service placement] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:00.381593 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3f6f0-92a4-4c05-bf31-46129b5e3177 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:00.390621 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3f6f0-92a4-4c05-bf31-46129b5e3177 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:16:00.393404 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3f6f0-92a4-4c05-bf31-46129b5e3177 service placement] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:16:00.403419 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 604/1227] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:16:00 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:16:00.493499 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92176f4-a54e-4078-9ab8-bb8373904318 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:16:00.577932 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92176f4-a54e-4078-9ab8-bb8373904318 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:16:00.582662 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:16:00.584366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:00.584651 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:00.584933 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] PATH_INFO: `/v3/users/eb8e78cfca424be49fe12af634309791` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:00.586150 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8e78cfca424be49fe12af634309791)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:16:00.587221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: WARNING py.warnings [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:16:00.587221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: warnings.warn(msg) Jun 06 07:16:00.587221 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: Jun 06 07:16:00.588450 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:16:00.846077 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8e78cfca424be49fe12af634309791'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:00.865335 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8e78cfca424be49fe12af634309791'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:00.866015 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8e78cfca424be49fe12af634309791'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:00.931996 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8e78cfca424be49fe12af634309791'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:00.943717 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8e78cfca424be49fe12af634309791'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:00.949748 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 624/1228] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jun 6 07:16:00 2022] DELETE /identity/v3/users/eb8e78cfca424be49fe12af634309791 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:16:01.248056 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3f6f0-92a4-4c05-bf31-46129b5e3177 service placement] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:16:01.259769 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3f6f0-92a4-4c05-bf31-46129b5e3177 service placement] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:16:01.316778 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:16:01.317694 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:01.317980 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:01.318261 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] PATH_INFO: `/v3/projects/aabe41662e0240c1a9407d3042bc2330` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:01.319472 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aabe41662e0240c1a9407d3042bc2330)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:16:01.320573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: WARNING py.warnings [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 06 07:16:01.320573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: warnings.warn(msg) Jun 06 07:16:01.320573 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: Jun 06 07:16:01.321756 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:16:01.424325 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aabe41662e0240c1a9407d3042bc2330', 'request_id': 'req-d7f7deab-336b-4f5a-a4d5-534b272b1a16'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.430999 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aabe41662e0240c1a9407d3042bc2330', 'request_id': 'req-d7f7deab-336b-4f5a-a4d5-534b272b1a16'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.494054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aabe41662e0240c1a9407d3042bc2330', 'request_id': 'req-d7f7deab-336b-4f5a-a4d5-534b272b1a16'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.524832 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] The token cache is being invalidate because project aabe41662e0240c1a9407d3042bc2330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 07:16:01.525124 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.525766 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.527368 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 605/1229] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jun 6 07:16:01 2022] DELETE /identity/v3/projects/aabe41662e0240c1a9407d3042bc2330 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:16:01.531569 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:16:01.533056 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:16:01.547070 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773518a-9ac7-46c4-8db5-2f382445922b admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:16:01.587991 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:16:01.605018 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:16:01.605914 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:01.606199 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:01.606515 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] PATH_INFO: `/v3/users/0d295ad58ec44a20bb1778f7bfed6de4` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:01.607720 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d295ad58ec44a20bb1778f7bfed6de4)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:16:01.609810 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:16:01.787972 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d295ad58ec44a20bb1778f7bfed6de4'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.799556 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d295ad58ec44a20bb1778f7bfed6de4'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.800233 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d295ad58ec44a20bb1778f7bfed6de4'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.864960 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d295ad58ec44a20bb1778f7bfed6de4'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.871951 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-14b1a1b9-2672-4173-98ea-50b1fc549a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d295ad58ec44a20bb1778f7bfed6de4'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:01.877752 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 625/1230] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jun 6 07:16:01 2022] DELETE /identity/v3/users/0d295ad58ec44a20bb1778f7bfed6de4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 07:16:02.090515 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:16:02.091987 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:16:02.101507 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:16:02.105307 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7deab-336b-4f5a-a4d5-534b272b1a16 admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:16:02.164633 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:16:02.165525 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:02.165809 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:02.166082 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] PATH_INFO: `/v3/projects/5472ad1e394d4d16a94e5b3ec2ba59b1` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:02.167331 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5472ad1e394d4d16a94e5b3ec2ba59b1)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:16:02.169286 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:16:02.288707 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5472ad1e394d4d16a94e5b3ec2ba59b1', 'request_id': 'req-2b6dc6f8-3582-452c-8c17-0b184600014b'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:02.294212 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5472ad1e394d4d16a94e5b3ec2ba59b1', 'request_id': 'req-2b6dc6f8-3582-452c-8c17-0b184600014b'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:02.373930 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5472ad1e394d4d16a94e5b3ec2ba59b1', 'request_id': 'req-2b6dc6f8-3582-452c-8c17-0b184600014b'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:02.385656 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] The token cache is being invalidate because project 5472ad1e394d4d16a94e5b3ec2ba59b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 07:16:02.385944 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:02.386606 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-2b6dc6f8-3582-452c-8c17-0b184600014b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:16:02.388157 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 606/1231] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jun 6 07:16:02 2022] DELETE /identity/v3/projects/5472ad1e394d4d16a94e5b3ec2ba59b1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:16:11.874386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=34,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:16:12.382618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:16:23.313956 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2919bd4-7a53-4ef0-85b5-560ec2da5947 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:23.314465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2919bd4-7a53-4ef0-85b5-560ec2da5947 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:23.314568 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2919bd4-7a53-4ef0-85b5-560ec2da5947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:23.331860 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-e2919bd4-7a53-4ef0-85b5-560ec2da5947 None None] MFA Rules not processed for user `0bdb5abd75984a39ad3efbc4a7838c31`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:16:23.337468 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-e2919bd4-7a53-4ef0-85b5-560ec2da5947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:16:23.386853 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 626/1232] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:16:23 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 06 07:16:33.380267 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=25 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:16:39.869355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31edfb3-c8af-49bf-9e38-7a062bc0f563 None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:39.869847 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31edfb3-c8af-49bf-9e38-7a062bc0f563 None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:39.869951 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31edfb3-c8af-49bf-9e38-7a062bc0f563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:39.887686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-d31edfb3-c8af-49bf-9e38-7a062bc0f563 None None] MFA Rules not processed for user `0bdb5abd75984a39ad3efbc4a7838c31`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:16:39.888884 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-d31edfb3-c8af-49bf-9e38-7a062bc0f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:16:39.896383 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 607/1233] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:16:39 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:16:40.403178 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83906c52-8758-468b-8b10-ddac3e2da0a4 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:40.403650 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83906c52-8758-468b-8b10-ddac3e2da0a4 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:40.403749 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83906c52-8758-468b-8b10-ddac3e2da0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:40.448250 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-83906c52-8758-468b-8b10-ddac3e2da0a4 None None] MFA Rules not processed for user `77904d1264284c29b2d0b73831dd4096`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:16:40.449438 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-83906c52-8758-468b-8b10-ddac3e2da0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:16:40.516115 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 627/1234] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Jun 6 07:16:40 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:16:40.527069 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31edfb3-c8af-49bf-9e38-7a062bc0f563 None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:16:40.528466 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-d31edfb3-c8af-49bf-9e38-7a062bc0f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:16:40.540399 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31edfb3-c8af-49bf-9e38-7a062bc0f563 None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:16:40.543962 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ce830-5b79-423c-9070-4094cf867a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:16:40.544602 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ce830-5b79-423c-9070-4094cf867a4d service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:16:40.544892 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ce830-5b79-423c-9070-4094cf867a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:16:40.545176 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ce830-5b79-423c-9070-4094cf867a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:16:40.552608 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ce830-5b79-423c-9070-4094cf867a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:16:40.554035 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ce830-5b79-423c-9070-4094cf867a4d service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:16:40.561676 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 608/1235] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:16:40 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:16:50.512770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=41 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:16:50.558347 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=9 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:17:00.335620 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca669-3442-4c29-a3e1-43fb5feea882 None None] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:17:00.336159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca669-3442-4c29-a3e1-43fb5feea882 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:17:00.336159 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca669-3442-4c29-a3e1-43fb5feea882 None None] PATH_INFO: `/` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:17:00.337909 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 628/1236] 10.222.0.42 () {54 vars in 921 bytes} [Mon Jun 6 07:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 06 07:17:00.343420 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab19560-16cd-42ce-a4a0-2471d4acf46e None None] REQUEST_METHOD: `POST` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:17:00.343963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab19560-16cd-42ce-a4a0-2471d4acf46e None None] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:17:00.343963 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab19560-16cd-42ce-a4a0-2471d4acf46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:17:00.409439 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.auth.core [None req-3ab19560-16cd-42ce-a4a0-2471d4acf46e None None] MFA Rules not processed for user `f446e118975f44b4b31511302a7af36e`. Rule list: `[]` (Enabled: `True`). {{(pid=87365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:17:00.410774 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-3ab19560-16cd-42ce-a4a0-2471d4acf46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:17:00.487721 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 609/1237] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Jun 6 07:17:00 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:17:00.499529 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ca669-3442-4c29-a3e1-43fb5feea882 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:17:00.501285 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-490ca669-3442-4c29-a3e1-43fb5feea882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:17:00.517537 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ca669-3442-4c29-a3e1-43fb5feea882 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:17:00.522465 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e7418-2b97-4935-a337-4a094915fa0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:17:00.523100 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e7418-2b97-4935-a337-4a094915fa0a service nova] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:17:00.523386 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e7418-2b97-4935-a337-4a094915fa0a service nova] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:17:00.523665 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e7418-2b97-4935-a337-4a094915fa0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:17:00.532185 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e7418-2b97-4935-a337-4a094915fa0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:17:00.537661 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e7418-2b97-4935-a337-4a094915fa0a service nova] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:17:00.543850 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 629/1238] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:17:00 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:17:01.318137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab19560-16cd-42ce-a4a0-2471d4acf46e None None] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:17:01.320217 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-3ab19560-16cd-42ce-a4a0-2471d4acf46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:17:01.410536 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab19560-16cd-42ce-a4a0-2471d4acf46e None None] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:17:01.415758 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3c0e5-71a7-4d03-a810-cc867c8844ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b6268131ad4545a07647d41b864f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:17:01.416415 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3c0e5-71a7-4d03-a810-cc867c8844ac service placement] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:17:01.416706 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3c0e5-71a7-4d03-a810-cc867c8844ac service placement] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:17:01.416988 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3c0e5-71a7-4d03-a810-cc867c8844ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:17:01.418793 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-cad3c0e5-71a7-4d03-a810-cc867c8844ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:17:01.430785 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3c0e5-71a7-4d03-a810-cc867c8844ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:17:01.432401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3c0e5-71a7-4d03-a810-cc867c8844ac service placement] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:17:01.442054 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 610/1239] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:17:01 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:17:10.539901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=6 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:17:11.438021 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=75 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:17:59.387411 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d885bd5-d2f0-4aee-a7ef-96898d30b103 None None] REQUEST_METHOD: `POST` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:17:59.387913 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d885bd5-d2f0-4aee-a7ef-96898d30b103 None None] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:17:59.388000 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d885bd5-d2f0-4aee-a7ef-96898d30b103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:17:59.405054 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.auth.core [None req-4d885bd5-d2f0-4aee-a7ef-96898d30b103 None None] MFA Rules not processed for user `0bdb5abd75984a39ad3efbc4a7838c31`. Rule list: `[]` (Enabled: `True`). {{(pid=87366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 06 07:17:59.406260 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-4d885bd5-d2f0-4aee-a7ef-96898d30b103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:17:59.413769 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 630/1240] 10.222.0.42 () {58 vars in 957 bytes} [Mon Jun 6 07:17:59 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 06 07:18:09.400354 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=3 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:18:13.759317 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3c0e5-71a7-4d03-a810-cc867c8844ac service placement] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:18:13.768581 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3c0e5-71a7-4d03-a810-cc867c8844ac service placement] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:18:13.772140 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:18:13.772780 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:18:13.773066 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:18:13.773374 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:18:13.775181 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:18:13.837137 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:18:13.838597 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:18:13.849198 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 611/1241] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:18:13 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:18:23.843771 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=30 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:20:01.686727 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d885bd5-d2f0-4aee-a7ef-96898d30b103 None None] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:20:01.696323 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d885bd5-d2f0-4aee-a7ef-96898d30b103 None None] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:20:01.699975 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:20:01.700616 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:20:01.700901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:20:01.701179 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:20:01.702984 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:20:01.712509 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:20:01.713898 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:20:01.721626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 631/1242] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:20:01 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:20:11.718295 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=6 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:21:33.789401 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:21:33.790857 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:33.823820 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c9050-939f-4266-941e-6fb4562b5eb4 service neutron] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:21:33.828718 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0fb81-2672-4b46-bc04-ce9b104921db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f446e118975f44b4b31511302a7af36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:21:33.829365 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0fb81-2672-4b46-bc04-ce9b104921db service nova] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:21:33.829652 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0fb81-2672-4b46-bc04-ce9b104921db service nova] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:21:33.829933 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0fb81-2672-4b46-bc04-ce9b104921db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:21:33.831700 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-cba0fb81-2672-4b46-bc04-ce9b104921db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:33.841744 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0fb81-2672-4b46-bc04-ce9b104921db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:21:33.843352 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0fb81-2672-4b46-bc04-ce9b104921db service nova] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:21:33.852977 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 612/1243] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:21:33 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:21:36.349520 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:21:36.351067 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:36.375328 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5bfef-4976-4ef0-bdc7-d303a715b158 service neutron] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:21:36.379850 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978f42e-b146-41a3-af9b-88fe71d60343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:21:36.380498 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978f42e-b146-41a3-af9b-88fe71d60343 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:21:36.380789 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978f42e-b146-41a3-af9b-88fe71d60343 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:21:36.381080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978f42e-b146-41a3-af9b-88fe71d60343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:21:36.382924 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-b978f42e-b146-41a3-af9b-88fe71d60343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:36.396419 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978f42e-b146-41a3-af9b-88fe71d60343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:21:36.397890 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978f42e-b146-41a3-af9b-88fe71d60343 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:21:36.408422 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 632/1244] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:21:36 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:21:37.586420 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0fb81-2672-4b46-bc04-ce9b104921db service nova] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:21:37.595441 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0fb81-2672-4b46-bc04-ce9b104921db service nova] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:21:37.598921 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:21:37.599551 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:21:37.599836 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:21:37.600112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:21:37.601949 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:37.614006 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:21:37.615528 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:21:37.626216 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 613/1245] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:21:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:21:46.403777 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=11 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:21:46.753415 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978f42e-b146-41a3-af9b-88fe71d60343 service neutron] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:21:46.761856 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978f42e-b146-41a3-af9b-88fe71d60343 service neutron] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:21:46.765455 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77904d1264284c29b2d0b73831dd4096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:21:46.766088 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:21:46.766400 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:21:46.766682 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:21:46.768978 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:46.833333 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:21:46.834859 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:21:46.844461 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 633/1246] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:21:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:21:47.621396 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=17 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:21:50.246523 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:21:50.247990 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:50.262652 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242196a9-8181-4ea5-b9ea-56e0d517a453 service neutron] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:21:50.267618 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323f8ab-0a93-4503-b0be-3c6525397b32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b6268131ad4545a07647d41b864f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:21:50.268839 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f8ab-0a93-4503-b0be-3c6525397b32 service placement] REQUEST_METHOD: `GET` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:21:50.269124 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f8ab-0a93-4503-b0be-3c6525397b32 service placement] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:21:50.269406 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f8ab-0a93-4503-b0be-3c6525397b32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:21:50.271161 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-1323f8ab-0a93-4503-b0be-3c6525397b32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:50.282686 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323f8ab-0a93-4503-b0be-3c6525397b32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:21:50.284355 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323f8ab-0a93-4503-b0be-3c6525397b32 service placement] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:21:50.294657 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 614/1247] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:21:50 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:21:53.776271 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:21:53.777843 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:53.790352 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b3f01-d9c6-4353-9f77-b5c79fdf25d5 service neutron] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:21:53.795080 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:21:53.795955 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:21:53.796244 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:21:53.797091 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] PATH_INFO: `/v3/users/0bdb5abd75984a39ad3efbc4a7838c31` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:21:53.797737 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bdb5abd75984a39ad3efbc4a7838c31)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:21:53.800366 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:21:54.043770 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bdb5abd75984a39ad3efbc4a7838c31'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.056921 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bdb5abd75984a39ad3efbc4a7838c31'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.057657 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bdb5abd75984a39ad3efbc4a7838c31'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.120844 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bdb5abd75984a39ad3efbc4a7838c31'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.128357 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bdb5abd75984a39ad3efbc4a7838c31'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.134313 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 634/1248] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jun 6 07:21:53 2022] DELETE /identity/v3/users/0bdb5abd75984a39ad3efbc4a7838c31 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:21:54.379156 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323f8ab-0a93-4503-b0be-3c6525397b32 service placement] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:21:54.392112 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323f8ab-0a93-4503-b0be-3c6525397b32 service placement] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:21:54.455130 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:21:54.456560 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:21:54.456847 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:21:54.457126 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] PATH_INFO: `/v3/projects/6abd865155bd4f5a98a7ab41b228bc6c` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:21:54.458314 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6abd865155bd4f5a98a7ab41b228bc6c)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:21:54.460245 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:21:54.566693 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6abd865155bd4f5a98a7ab41b228bc6c', 'request_id': 'req-cf6e1051-e88d-4259-9750-a9146f4242aa'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.572989 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6abd865155bd4f5a98a7ab41b228bc6c', 'request_id': 'req-cf6e1051-e88d-4259-9750-a9146f4242aa'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.641141 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6abd865155bd4f5a98a7ab41b228bc6c', 'request_id': 'req-cf6e1051-e88d-4259-9750-a9146f4242aa'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.653422 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] The token cache is being invalidate because project 6abd865155bd4f5a98a7ab41b228bc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 07:21:54.653676 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.654319 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.655995 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 615/1249] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jun 6 07:21:54 2022] DELETE /identity/v3/projects/6abd865155bd4f5a98a7ab41b228bc6c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:21:54.660677 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:21:54.664345 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:54.675998 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2cad-7b7a-4fe5-a3ea-6fb69aac12fa admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:21:54.732191 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:21:54.733066 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:21:54.733349 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:21:54.733626 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] PATH_INFO: `/v3/users/eb3d815d4fae4b75b6745999ceb85b05` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:21:54.734846 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3d815d4fae4b75b6745999ceb85b05)` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:21:54.736856 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:21:54.742068 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:21:54.876933 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3d815d4fae4b75b6745999ceb85b05'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.899464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3d815d4fae4b75b6745999ceb85b05'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.899464 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3d815d4fae4b75b6745999ceb85b05'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.966293 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3d815d4fae4b75b6745999ceb85b05'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.973901 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.notifications [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3d815d4fae4b75b6745999ceb85b05'} {{(pid=87366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:54.979819 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 635/1250] 10.222.0.42 () {58 vars in 1223 bytes} [Mon Jun 6 07:21:54 2022] DELETE /identity/v3/users/eb3d815d4fae4b75b6745999ceb85b05 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 06 07:21:55.237067 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] Authenticating user token {{(pid=87365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:21:55.244615 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.fernet_utils [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:21:55.254145 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1051-e88d-4259-9750-a9146f4242aa admin admin] Validating token access rules against request {{(pid=87365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:21:55.311549 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd63265941a9946a497001fc63bf2b23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d774be4b4f647c4aa73f115724f3d96', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:21:55.312423 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:21:55.312714 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] SCRIPT_NAME: `/identity` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:21:55.312996 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] PATH_INFO: `/v3/projects/9fb845e099ed4e8d97a387064b275cb6` {{(pid=87365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:21:55.314187 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb845e099ed4e8d97a387064b275cb6)` {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:21:55.316852 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] RBAC: Authorization granted {{(pid=87365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:21:55.337589 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:21:55.429746 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb845e099ed4e8d97a387064b275cb6', 'request_id': 'req-89ae9ed0-989e-4a5f-8ed6-589205787cec'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:55.434974 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb845e099ed4e8d97a387064b275cb6', 'request_id': 'req-89ae9ed0-989e-4a5f-8ed6-589205787cec'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:55.514781 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb845e099ed4e8d97a387064b275cb6', 'request_id': 'req-89ae9ed0-989e-4a5f-8ed6-589205787cec'} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:55.525969 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] The token cache is being invalidate because project 9fb845e099ed4e8d97a387064b275cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 06 07:21:55.526267 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:55.526937 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG keystone.notifications [None req-89ae9ed0-989e-4a5f-8ed6-589205787cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 06 07:21:55.528485 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: [pid: 87365|app: 0|req: 616/1251] 10.222.0.42 () {58 vars in 1232 bytes} [Mon Jun 6 07:21:55 2022] DELETE /identity/v3/projects/9fb845e099ed4e8d97a387064b275cb6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 06 07:22:04.976343 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:22:05.538191 dv-osbrick-830800-20-ceph devstack@keystone.service[87365]: DEBUG dbcounter [-] [87365] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 07:22:58.966572 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] Authenticating user token {{(pid=87366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 06 07:22:58.967966 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:22:59.050796 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713a8b2-44a5-4275-b373-3bebd3d7ec8d admin admin] Validating token access rules against request {{(pid=87366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 06 07:22:59.108089 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90dd6f-6629-435b-a14a-c5806f8d719e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b6268131ad4545a07647d41b864f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518ead35f9cb42f7b67bbe66e16c3236', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 06 07:22:59.108742 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90dd6f-6629-435b-a14a-c5806f8d719e service placement] REQUEST_METHOD: `GET` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 06 07:22:59.109035 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90dd6f-6629-435b-a14a-c5806f8d719e service placement] SCRIPT_NAME: `/identity` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 06 07:22:59.109316 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90dd6f-6629-435b-a14a-c5806f8d719e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 06 07:22:59.111113 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.fernet_utils [None req-cb90dd6f-6629-435b-a14a-c5806f8d719e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 06 07:22:59.122114 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90dd6f-6629-435b-a14a-c5806f8d719e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 06 07:22:59.123751 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90dd6f-6629-435b-a14a-c5806f8d719e service placement] RBAC: Authorization granted {{(pid=87366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 06 07:22:59.133243 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: [pid: 87366|app: 0|req: 636/1252] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Jun 6 07:22:58 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 06 07:23:09.129338 dv-osbrick-830800-20-ceph devstack@keystone.service[87366]: DEBUG dbcounter [-] [87366] Writing DB stats keystone:SELECT=63 {{(pid=87366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}